portkey-python-sdk Alternatives

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Achieve state of the art inference performance with modern accelerators on Kubernetes

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

mloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build Real-Time Knowledge Graphs for AI Agents

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build reliable, secure, and production-ready AI apps easily.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A modular graph-based Retrieval-Augmented Generation (RAG) system

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Easiest and laziest way for building multi-agent LLMs applications.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No database required, built-in cost tracking, budget enforcement and multi-tenant isolation.