Alternatives Engine

llm-gateway Alternatives

Compare open-source alternatives to openziti/llm-gateway by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

openziti/llm-gateway has 12 alternative candidates. Top match is vllm-project/aibrix at 100/100 because Same llm gateway intent with llm_gateway overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123087vllm-project/aibrix
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

openziti/llm-gateway

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Go Apache-2.0 LocalCloud

Best For

Where llm-gateway fits

route LLM requests
standardize model provider access
add gateway-level controls

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation

Comparison Table

vllm-project/aibrix leads this comparison context

vllm-project/aibrix has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
openziti/llm-gatewaySource95GoLocal, Cloud1054
vllm-project/aibrix100/1005,113GoKubernetes, Local3378
Hal0ai/hal0100/10074PythonLocal, Cloud2962
andreimerfu/pllm100/10027GoDocker, Kubernetes954
trefeon/freebucks-proxy92/100297GoDocker, Local3667
MiXaiLL76/auto_ai_router91/10052GoDocker, Local2261

Alternative Match

vllm-project/aibrix

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Cost-efficient and pluggable Infrastructure components for GenAI inference

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality33
Agent78

Alternative Match

Hal0ai/hal0

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality29
Agent62

Alternative Match

andreimerfu/pllm

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

High-performance LLM Gateway built in Go - OpenAI compatible proxy with multi-provider support, adaptive routing, and enterprise features

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality9
Agent54

Alternative Match

trefeon/freebucks-proxy

92/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

[DEPRECATED / UNMAINTAINED] Multi-account gateway. No longer maintained; fork it and maintain yourself.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality36
Agent67

Alternative Match

MiXaiLL76/auto_ai_router

91/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality22
Agent61

Alternative Match

sxueck/llm-gateway

85/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Lightweight distributed LLM gateway w/ web UI for model mgmt & routing. Supports vibe programming, prompt opt., & optimized OpenAI API/Anthropic calls

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality24
Agent61

Alternative Match

off-grid-ai/OGAD

82/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality31
Agent65

Alternative Match

VkRainB/ccMesh

82/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Claude Code / Codex local AI proxy gateway desktop app (Tauri). Anthropic Messages <-> OpenAI-compatible protocol transform, model mapping, endpoint rotation/failover. 本地桌面代理网关：协议转换、模型映射、多端点轮换/熔断，对接官方 API 或中转站，不改客户端。Windows/macOS/Linux.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality30
Agent64

Alternative Match

openai/openai-openapi

81/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAPI specification for the OpenAI API

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality20
Agent69

Alternative Match

Ahoo-Wang/GodeX

81/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Make every model a CodeX engine through an OpenAI-compatible Responses API gateway

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality20
Agent55

Alternative Match

Devansh-365/freellm

74/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible gateway aggregating 8 free LLM providers with automatic failover, circuit breakers, and smart routing. 32+ models, zero cost.

Llm GatewayLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local.
Quality13
Agent59

Alternative Match

BuilderIO/ai-shell

74/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A CLI that converts natural language to shell commands.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality10
Agent64

Data Source

d1 / d1_query

1213 loaded projects. Generated at 2026-09-26T17:26:14.222Z.