Library Only Deployment Projects

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

The agent engineering platform.

LLM inference in C/C++

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

A high-throughput and memory-efficient inference and serving engine for LLMs

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

🙌 OpenHands: AI-Driven Development

🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.