Buzz
A self-hosted model API gateway
Connect model providers through one gateway. Give users their own API keys and manage models, keys, and request activity in a web admin interface.
Self-hosted · Docker Compose · MIT license
Features
- Models and routes
- Define the model names your users see, then configure upstream providers and routes for each model.
- Users and API keys
- Give users independent access keys and manage upstream provider keys in one place.
- Retries and failover
- Retry, cool down, and switch between the routes configured for a model when an upstream service has problems.
- Invalid key handling
- Detect invalid or disabled upstream keys, disable them automatically, and inspect their status in the admin interface.
- Web administration
- Manage users, models, providers, and keys in a browser. Review runtime status and request counts.
- Your own deployment
- Deploy with Docker Compose. Postgres stores configuration data; Redis stores sessions and short-lived runtime state.
Supported interfaces
| Protocol | Endpoint |
|---|---|
| OpenAI Chat Completions | /v1/chat/completions |
| OpenAI Responses | /v1/responses |
| Anthropic Messages | /v1/messages |
| Gemini GenerateContent | /v1beta/models/{model}:generateContent |
| Gemini streaming | /v1beta/models/{model}:streamGenerateContent |
Matching protocols pass through directly. Other requests use the supported conversion paths for text, images, basic tool calls, and text streaming. See the project documentation for advanced streaming limitations.
Getting started
Deploy the service
Follow the installation guide to run Buzz, Postgres, and Redis on your server.
Configure providers
Create the initial administrator, then add providers, upstream keys, and model routes.
Connect a client
Create a user API key and point a compatible client at your Buzz service.
Before you start
Does Buzz include model credits?
Buzz manages APIs and routing. Connect your own providers and keys; model usage and charges are handled by those providers.
Can I use it independently?
Yes. Buzz is a standalone service for clients that support its API protocols. It can also serve as a model endpoint for Pudding.
What is the source license?
Buzz is open source under the MIT license. The repository contains the installation guide and full license.