Alternatives Engine

llm-gateway Alternatives

Compare open-source alternatives to openziti/llm-gateway by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

openziti/llm-gateway has 12 alternative candidates. Top match is Hal0ai/hal0 at 100/100 because Same llm gateway intent with llm_gateway overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123084Hal0ai/hal0
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

openziti/llm-gateway

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Go Apache-2.0 LocalCloud

Best For

Where llm-gateway fits

route LLM requests
standardize model provider access
add gateway-level controls

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation

Comparison Table

Hal0ai/hal0 leads this comparison context

Hal0ai/hal0 has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
openziti/llm-gatewaySource105GoLocal, Cloud1153
Hal0ai/hal0100/10085PythonLocal, Cloud3163
MiXaiLL76/auto_ai_router100/10057GoDocker, Local1860
andreimerfu/pllm100/10029GoDocker, Kubernetes452
trefeon/freebucks-proxy87/100297GoDocker, Local2062
sxueck/llm-gateway85/10054TypeScriptDocker, Local2261

Alternative Match

Hal0ai/hal0

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality31
Agent63

Alternative Match

MiXaiLL76/auto_ai_router

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality18
Agent60

Alternative Match

andreimerfu/pllm

100/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

High-performance LLM Gateway built in Go - OpenAI compatible proxy with multi-provider support, adaptive routing, and enterprise features

ExplicitLlm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality4
Agent52

Alternative Match

trefeon/freebucks-proxy

87/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Archived; no longer maintained.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality20
Agent62

Alternative Match

sxueck/llm-gateway

85/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Lightweight distributed LLM gateway w/ web UI for model mgmt & routing. Supports vibe programming, prompt opt., & optimized OpenAI API/Anthropic calls

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality22
Agent61

Alternative Match

izzoa/polyrouter

85/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A self-hostable LLM router / gateway: OpenAI- and Anthropic-compatible, explicit-first routing with fallbacks, spend limits, and metadata-only cost tracking. No markup, no third-party proxy — your keys, your box.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality21
Agent58

Alternative Match

VkRainB/ccMesh

81/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Claude Code / Codex local AI proxy gateway desktop app (Tauri). Anthropic Messages <-> OpenAI-compatible protocol transform, model mapping, endpoint rotation/failover. 本地桌面代理网关：协议转换、模型映射、多端点轮换/熔断，对接官方 API 或中转站，不改客户端。Windows/macOS/Linux.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality24
Agent63

Alternative Match

openai/openai-openapi

81/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAPI specification for the OpenAI API

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality21
Agent69

Alternative Match

BuilderIO/ai-shell

74/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A CLI that converts natural language to shell commands.

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality9
Agent64

Alternative Match

Devansh-365/freellm

73/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible gateway aggregating 8 free LLM providers with automatic failover, circuit breakers, and smart routing. 32+ models, zero cost.

Llm GatewayLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local.
Quality7
Agent56

Alternative Match

Nutlope/llamacoder

73/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open source Claude Artifacts – built with Llama 3.1 405B

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality6
Agent60

Alternative Match

frieser/antigravity-proxy

73/100

Same llm gateway intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Antigravity Proxy is a high-performance gateway that exposes Google's internal Gemini and Claude APIs through an OpenAI-compatible interface

Llm GatewayLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality6
Agent52

Data Source

d1 / d1_query

1226 loaded projects. Generated at 2026-11-11T00:23:30.716Z.