Git.Top Guide

AI Observability Tools

Open-source tracing, prompt logging, evaluation, cost tracking, and runtime analysis tools for AI products.

Guide

What To Inspect

Evaluate AI observability projects by tracing depth, prompt and completion capture, evaluation workflows, privacy controls, integrations, and whether the project is production-ready or analysis-focused.

Guide

Best Use

Use this page when selecting tools for monitoring LLM apps, debugging agent runs, tracking costs, reviewing prompts, or comparing quality across model and retrieval changes.

Data Source

d1 / d1_query

1226 loaded projects. Generated at 2026-11-11T00:12:49.046Z.

Project

pydantic/logfire

83

AI observability platform for production LLM and agent systems.

Ai ObservabilityLibrary OnlyLocalCloud
Quality45
Agent83

Project

openlit/openlit

83

Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.

Ai ObservabilityDockerLibrary OnlyLocal
Quality44
Agent83

CNCF Jaeger, a Distributed Tracing Platform

Ai ObservabilityDockerLocalCloud
Quality39
Agent82

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Ai ObservabilityLibrary OnlyLocalCloud
Quality30
Agent78

Project

Dynatrace/dtctl

75

CLI for managing Dynatrace platform resources - built for humans and AI agents

Ai ObservabilityKubernetesLocalCloud
Quality35
Agent75

This repo was archived on Oct 16, 2026. Python SDK moved to langchain-ai/langsmith-python and JS SDK to langchain-ai/langsmith-javascript.

Ai ObservabilityLibrary OnlyLocalCloud
Quality36
Agent76

Project

apache/hertzbeat

78

An AI-powered next-generation open source real-time observability system.

Ai ObservabilityDockerKubernetesLocal
Quality25
Agent78

lightweight system-level observability for AI Agents

Ai ObservabilityDockerLibrary OnlyLocal
Quality24
Agent68

Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.

Ai ObservabilityDockerKubernetesLibrary Only
Quality33
Agent74

🪢 Langfuse JS/TS SDK

Ai ObservabilityVercelServerlessLibrary Only
Quality29
Agent72

Self-hosted AI SRE for Kubernetes — zero-instrumentation eBPF observability plus a copilot that fixes issues through guardrailed, self-verifying actions. BYO-LLM, air-gapped capable.

Ai ObservabilityDockerKubernetesLibrary Only
Quality19
Agent63

OpenTelemetry Instrumentation for AI Observability

Ai ObservabilityVercelServerlessLocal
Quality46
Agent81