Alternatives Engine

free-llm-gateway Alternatives

Compare open-source alternatives to MrFadiAi/free-llm-gateway by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

MrFadiAi/free-llm-gateway has 12 alternative candidates. Top match is bytedance/deer-flow at 100/100 because Same rag framework intent with rag, llm_gateway overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123098bytedance/deer-flow
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

MrFadiAi/free-llm-gateway

Unified OpenAI-compatible API gateway aggregating 14+ free LLM providers with automatic fallback routing, rate limit tracking, and web dashboard

Python Unknown license DockerCloudflareServerless

Best For

Where free-llm-gateway fits

build RAG applications
connect private data to LLMs
index documents for retrieval

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation
users expecting a complete hosted product

Comparison Table

bytedance/deer-flow leads this comparison context

bytedance/deer-flow has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
MrFadiAi/free-llm-gatewaySource210PythonDocker, Cloudflare557
bytedance/deer-flow100/10082,982PythonDocker, Library Only7285
llm-d/llm-d100/1004,652PythonDocker, Kubernetes4982
mozilla-ai/otari100/100479PythonDocker, Local3673
mloda-ai/mloda100/10088PythonDocker, Library Only3674
schmitech/orbit100/100351PythonDocker, Library Only1965

Alternative Match

bytedance/deer-flow

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

ExplicitRag FrameworkDockerLibrary OnlyVector Database
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality72
Agent85

Alternative Match

llm-d/llm-d

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Achieve state of the art inference performance with modern accelerators on Kubernetes

ExplicitRag FrameworkDockerLocalVector Database
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local.
Quality49
Agent82

Alternative Match

mozilla-ai/otari

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

ExplicitRag FrameworkDockerLocalVector Database
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local.
Quality36
Agent73

Alternative Match

mloda-ai/mloda

100/100

Same rag framework intent with rag, observability overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

mloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic.

Rag FrameworkDockerLibrary OnlyVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality36
Agent74

Alternative Match

schmitech/orbit

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.

Rag FrameworkDockerLibrary OnlyVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality19
Agent65

Alternative Match

Nayjest/lm-proxy

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

Rag FrameworkDockerLibrary OnlyVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality14
Agent59

Alternative Match

Portkey-AI/portkey-python-sdk

100/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build reliable, secure, and production-ready AI apps easily.

Rag FrameworkLibrary OnlyLocalVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: library_only, local.
Quality13
Agent58

Alternative Match

QuantumNous/new-api

98/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.

Rag FrameworkDockerLocalVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local.
Quality84
Agent87

Alternative Match

huggingface/transformers

96/100

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Rag FrameworkLibrary OnlyLocalVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: library_only, local.
Quality84
Agent88

Alternative Match

occludra/gateway

96/100

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI security proxy. Redact PII, block prompt injection, route to any LLM provider. OpenAI-compatible.

Rag FrameworkDockerLibrary OnlyVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality7
Agent53

Alternative Match

mem0ai/mem0

95/100

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

Rag FrameworkDockerServerlessVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, serverless, library_only.
Quality78
Agent89

Alternative Match

langchain-ai/langgraph

95/100

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build resilient agents.

Rag FrameworkLibrary OnlyLocalVector DatabaseLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: library_only, local.
Quality78
Agent85

Data Source

d1 / d1_query

1213 loaded projects. Generated at 2026-09-26T16:53:29.978Z.