Alternatives Engine

litellm Alternatives

Compare open-source alternatives to BerriAI/litellm by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

BerriAI/litellm has 12 alternative candidates. Top match is headroomlabs-ai/headroom at 100/100 because Same mcp server intent with mcp, llm_gateway overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123199headroomlabs-ai/headroom
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Python NOASSERTION DockerLibrary OnlyLocal

Best For

Where litellm fits

connect agents to tools
expose APIs through MCP
bootstrap MCP integrations

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation
users expecting a complete hosted product

Comparison Table

headroomlabs-ai/headroom leads this comparison context

headroomlabs-ai/headroom has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
BerriAI/litellmSource59,585PythonDocker, Library Only8489
headroomlabs-ai/headroom100/10073,798PythonDocker, Vercel8492
shibing624/agentica100/100351PythonDocker, Library Only3069
coddy-project/coddy-agent100/100151GoDocker, Local3065
soapbucket/sbproxy100/10053RustDocker, Kubernetes2964
stdapi-ai/stdapi.ai100/10024PythonDocker, Local2961

Alternative Match

headroomlabs-ai/headroom

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

ExplicitMcp ServerDockerLibrary OnlyMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality84
Agent92

Alternative Match

shibing624/agentica

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

One person, a team of agents. Multi-session CLI that collaborates across terminals; /goal keeps long tasks running; WeChat/WeCom/Feishu gateway lets you call them back when you walk away. Async Python SDK, persistent memory, self-evolving skills.

ExplicitMcp ServerDockerLibrary OnlyMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality30
Agent69

Alternative Match

coddy-project/coddy-agent

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

General-purpose agent in one static Go binary: console TUI, ACP server for editors, OpenAI-compatible API with embedded web UI, Telegram gateway, cron scheduler, swarm relay, remote mode. Rules, skills, subagents, hooks, MCP, background tasks, long-term memory, context compaction. Any OpenAI-compatible provider, distroless-ready.

ExplicitMcp ServerDockerLocalMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality30
Agent65

Alternative Match

soapbucket/sbproxy

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality29
Agent64

Alternative Match

stdapi-ai/stdapi.ai

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for Amazon Bedrock. OpenAI, Anthropic, Cohere and Ollama compatible APIs, plus Amazon Polly, Transcribe and Comprehend.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality29
Agent61

Alternative Match

ax128/AegisGate

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source security gateway for LLM APIs — prompt injection detection, PII redaction, dangerous response sanitization, and audit logging. OpenAI/Claude compatible, MCP & Agent SKILL support. Drop-in proxy for AI coding agents (Cursor, Claude Code, Codex).

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality15
Agent59

Alternative Match

Portkey-AI/hoot

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

MCP Testing Tool — Like Postman, but for the Model Context Protocol.

Mcp ServerLibrary OnlyLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: library_only, local.
Quality4
Agent53

Alternative Match

deepset-ai/haystack

99/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality52
Agent88

Alternative Match

Portkey-AI/gateway

99/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality26
Agent77

Alternative Match

KochC/opencode-llm-proxy

99/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Local OpenCode-backed LLM gateway for OpenAI, Anthropic, Gemini, and Responses API-compatible tools, with streaming and tool/function calling.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality20
Agent61

Alternative Match

agentic-community/mcp-gateway-registry

98/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Enterprise-ready MCP Gateway & Registry that centralizes AI development tools with secure OAuth authentication, dynamic tool discovery, and unified access for both autonomous AI agents and AI coding assistants. Transform scattered MCP server chaos into governed, auditable tool access with Keycloak/Entra integration.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality43
Agent84

Alternative Match

rocketride-org/rocketride-server

97/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality83
Agent86

Data Source

d1 / d1_query

1213 loaded projects. Generated at 2026-09-26T16:14:47.115Z.