{"name":"bifrost: Route AI Models Through One Go Gateway","description":"Bifrost is a Go-based AI gateway that provides one OpenAI-compatible API for models across providers, with failover, load balancing, caching and governance features. It also supports MCP and agent gateway use cases.","github":"https://github.com/maximhq/bifrost","url":"https://osrepos.com/repo/maximhq-bifrost","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/maximhq-bifrost","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/maximhq-bifrost.md","json":"https://osrepos.com/repo/maximhq-bifrost.json","topics":["go","llm","api","proxy","llm-gateway","mcp-gateway","semantic-cache"],"keywords":["go","llm","api","proxy","llm-gateway","mcp-gateway","semantic-cache"],"stars":null,"summary":"Bifrost is a Go-based AI gateway that provides one OpenAI-compatible API for models across providers, with failover, load balancing, caching and governance features. It also supports MCP and agent gateway use cases.","content":"## Overview\n\nBifrost is a high-performance AI gateway built in Go. It gives applications one OpenAI-compatible API for accessing models from multiple providers, helping teams route requests and add reliability and governance without integrating each provider separately.\n\nThe project also frames itself as an MCP and agent gateway: it can connect model requests to external tools and supports agent-oriented workflows. It can run as an HTTP gateway with a web interface or be embedded through its Go SDK.\n\n## Key Features\n\n- OpenAI-compatible API across multiple model providers, with drop-in integration paths for existing SDKs.\n- Automatic fallbacks and load balancing across models, providers and API keys.\n- MCP support for connecting models to external tools.\n- Semantic caching to reuse responses based on similarity.\n- Governance features including virtual keys, usage tracking, rate limits and budgets.\n- Observability through metrics, tracing, logging and a web interface.\n- Plugin architecture for extending gateway behavior.\n\n## Use Cases\n\n- Platform teams can give several services a common API for models from different providers.\n- Production AI applications can route around provider or model failures using fallbacks and load balancing.\n- Teams building tool-using assistants can use the gateway's MCP support to connect models with external tools.\n- Organizations managing AI spend can apply virtual keys, usage limits and budgets across teams or customers.\n- Go developers can embed the gateway's SDK directly when an HTTP service boundary is not needed.\n\n## Our Take\n\nBifrost is an actively maintained Go gateway with a broad feature set for teams that want provider flexibility and operational controls behind one API.\n\n**Good fit if:**\n- You need an OpenAI-compatible gateway for multiple model providers, with routing and failover.\n- Your team wants MCP support or centralized usage controls such as budgets and virtual keys.\n- You can work with a Go-based project under the Apache-2.0 license.\n\n**Look elsewhere if:**\n- You only need a direct integration with one provider and do not need gateway-level routing or governance.\n- You need enterprise capabilities such as clustering, adaptive load balancing or guardrails without an enterprise deployment.\n- Your stack requires a gateway built in a different language and cannot use an HTTP service boundary.\n\n## Project Health\n\n| Signal | Value |\n|---|---|\n| Status | **Active**: regular commits and releases |\n| Last commit | 2026-11-13 (today) |\n| Commits, last 90 days | 100+ |\n| Releases, last 12 months | 100+ (latest transports/v2.5.1, 2026-11-10) |\n| Contributors | 100+ (top contributor: 32% of commits) |\n| Issues closed, last 90 days | 6+ (typically closed in 2 days) |\n| Pull requests merged, last 90 days | 81 (typically merged in 2 days) |\n| Project age | 20 months |\n\nChecked on 2026-11-13 with the GitHub API.\n\n## Project Facts\n\n- Language: Go\n- License: Apache-2.0\n- Stars: 9.5k\n- Forks: 1.6k\n- Topics: agent-gateway, ai-gateway, ai-governance, api-gateway, claude-code, coding-agents, failover, gateway\n- Website: https://www.getmaxim.ai/bifrost\n- Archived: no\n\n## What You Need\n\nDetected in the repository:\n\n- Go (main language on GitHub)\n- A test suite and automated checks on GitHub Actions\n\n## Getting Started\n\nStart the gateway with NPX:\n\n```bash\nnpx -y @maximhq/bifrost\n```\n\nThen open `http://localhost:8080` to configure it. See the [README](https://github.com/maximhq/bifrost) and [gateway setup guide](https://docs.getbifrost.ai/quickstart/gateway/setting-up) for configuration and deployment details.\n\n## License in Plain Words\n\n**Apache-2.0** (permissive).\n\n- Commercial use: yes\n- Modify and redistribute: yes\n- You must keep: the license, the NOTICE file and a note of your changes\n- Share your changes: no\n- Includes an explicit patent grant from the contributors\n\nA summary, not legal advice: the LICENSE file is what applies.\n\n## Alternatives\n\n- [kong](https://osrepos.com/repo/kong-kong): Kong is a broader API gateway for services as well as LLMs and MCP, while Bifrost focuses on AI model routing.\n- [a3m-router](https://osrepos.com/repo/das-rebel-a3m-router): A3M Router uses task-based Jev System One routing and optional parallel ensembles, rather than Bifrost's general gateway features.\n- [inference-gateway](https://osrepos.com/repo/inference-gateway-inference-gateway): Inference Gateway emphasizes cloud-native deployment and integrations such as A2A, guardrails, and OpenTelemetry.\n- [freellmapi](https://osrepos.com/repo/tashfeenahmed-freellmapi): FreeLLMAPI focuses on combining free provider accounts, quota tracking, and retries for personal experimentation.\n\n| Project | Language | License | Stars | Status |\n|---|---|---|---|---|\n| **bifrost** | Go | Apache-2.0 | 9.5k | Active |\n| [kong](https://osrepos.com/repo/kong-kong) | Lua | Apache-2.0 | 44.3k | Active |\n| [a3m-router](https://osrepos.com/repo/das-rebel-a3m-router) | TypeScript | MIT | 17 | New |\n| [inference-gateway](https://osrepos.com/repo/inference-gateway-inference-gateway) | Go | Apache-2.0 | 215 | Active |\n| [freellmapi](https://osrepos.com/repo/tashfeenahmed-freellmapi) | TypeScript | MIT | 30.3k | New |\n\n## Considerations\n\nBifrost is active, with recent commits and releases, and contributions from at least 100 contributors; activity is not concentrated in one person. The measured issue data shows a short median time to close, though the repository also has a sizable open issue backlog. The README distinguishes enterprise deployments for some advanced features, so check availability and deployment terms for capabilities such as clustering and guardrails. The project uses the Apache-2.0 license.","metrics":{"detailViews":1,"githubClicks":1},"dates":{"published":null,"modified":"2026-11-13T18:02:26.000Z"}}