# GoModel

> Open-source AI gateway and AI control plane written in Go. A single ~14 MB binary that routes 31 providers (OpenAI, Anthropic, Google Gemini, Vertex AI, Azure OpenAI, Amazon Bedrock, OpenRouter, Groq, xAI, DeepSeek, Ollama, vLLM, and more) behind OpenAI- and Anthropic-compatible APIs.

GoModel unifies access to hundreds of models through one endpoint: /v1/chat/completions, the /v1/responses and /v1/conversations lifecycles, and the Anthropic-compatible /v1/messages, plus embeddings, files, batches, audio, and realtime speech. On top of routing it adds model aliases and virtual models with load balancing, scoped workflows, guardrails, exact-match and semantic response caching, automatic failover with retries and a circuit breaker, budgets and rate limits, per-request usage and cost tracking, audit logs, virtual API keys, an MCP gateway, provider-native passthrough, session keeping, Prometheus metrics, OpenTelemetry traces, and an embedded admin dashboard with a request playground. Storage starts on SQLite and scales to PostgreSQL or MongoDB. In the reproducible August 2026 benchmark, GoModel showed 2.35 ms p50 latency overhead, 3,610 req/s sustained throughput, 43 MB peak RAM, and a 0.58 s cold start.

GoModel is the only product currently developed by [enterpilot, Inc.](https://enterpilot.io/). enterpilot, Inc. is the company and publisher; GoModel is its open-source software product.

## Docs
- [Documentation llms.txt index](https://gomodel.enterpilot.io/docs/llms.txt): Auto-updated index of every documentation page in llms.txt format
- [GitHub Repository](https://github.com/ENTERPILOT/GoModel): Source code, issues, releases
- [Documentation](https://gomodel.enterpilot.io/docs): Setup guides and API reference
- [Releases](https://github.com/ENTERPILOT/GoModel/releases): Download binaries and Docker images
- [AI Gateway Benchmark](https://enterpilot.io/blog/benchmarking-ai-gateways-gomodel-litellm-portkey-bifrost-june-2026/): GoModel vs LiteLLM vs Portkey vs Bifrost
- [Reproducible Benchmark Repository](https://github.com/ENTERPILOT/ai-gateway-reproducible-benchmark): One-command AWS harness, every recorded run, and a chart of the numbers over time

## Optional
- [Discord Community](https://discord.gg/gaEB9BQSPH): Community chat and support
- [Issues](https://github.com/ENTERPILOT/GoModel/issues): Bug reports and feature requests