Manifest
Open source LLM gateway that connects AI agents and workflows to any provider.
Manifest is an open-source LLM gateway and router that provides a single endpoint for sending requests to any model provider. It solves the problem of unreliable AI agents and workflows by handling provider downtime, fixing failing API requests automatically, and giving teams control over their inference consumption and spending.
The product offers automatic model fallback when a provider goes down, and a feature called Autofix that repairs broken requests on the fly before the error reaches the user. It includes full request and response logging, cost visualization broken down by agent and key, and supports bring-your-own-key setups for all providers. Users can route to local models via Ollama, LM Studio, or llama.cpp. The gateway is OpenAI-compatible and can be used as a hosted cloud service or self-hosted with Docker.
Manifest is designed for AI builders, teams, and platforms that need reliable AI products. It is free and open source under an MIT license, with a cloud version that starts with a free plan offering 10,000 routed requests per month and 7-day dashboard retention. A Pro plan for production projects provides unlimited requests and 365-day retention. Enterprise is available for teams needing on-premise deployment, SSO, audit logs, and a support contract.
12 alternatives to Manifest
Ranked by how well each tool replaces Manifest: shared features, audience, price and popularity.
Open-source AI gateway that puts your AI stack behind one OpenAI-compatible key.
Covers 11 of 15 key features.
Free planOpen source71 out of 100 matchFree- 66 out of 100 match$20/mo
- 64 out of 100 matchFree
Open-source AI gateway written in Go providing one OpenAI- and Anthropic-compatible API in
Covers 10 of 15 key features.
Free planOpen source63 out of 100 matchContact sales- 62 out of 100 matchUsage-based
- 62 out of 100 matchFree
- 61 out of 100 matchUsage-based
- 61 out of 100 matchContact sales
An API for open models, usable locally or in the cloud
Covers 2 of 15 key features.
Free planOpen source61 out of 100 match$100/mo- 60 out of 100 match$5/mo
- 60 out of 100 match$1,000/mo
- 60 out of 100 matchUsage-based