Data / Repositories / Llmops
Llmops repositories on GitHub: 14 ranked by stars
14 public repositories tagged Llmops are on GitHub, with 182,139 stars between them; 9 had a push in the last 30 days. Most are written in Python (7), TypeScript (4), Shell (1). The most starred: BerriAI/litellm (61,238), langfuse/langfuse (35,820), comet-ml/opik (22,597).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Language | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|---|
| BerriAI/litellm | The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock… | Python | 61,238 | 12,329 | Oct 14 | Oct 14 | |
| langfuse/langfuse | Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. | TypeScript | 35,820 | 3,987 | Oct 14 | Oct 14 | |
| comet-ml/opik | Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. | Python | 22,597 | 1,858 | Apache-2.0 | Oct 14 | Oct 14 |
| dipakkr/awesome-ai-engineering | A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems. | 22,382 | 4,834 | MIT | Jun 17 | Oct 14 | |
| Portkey-AI/gateway | A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. | TypeScript | 13,188 | 1,346 | MIT | May 25 | Oct 14 |
| Arize-ai/phoenix | AI Observability & Evaluation | Python | 11,834 | 1,203 | Oct 14 | Oct 14 | |
| tensorchord/Awesome-LLMOps | An awesome & curated list of best LLMOps tools for developers | Shell | 5,959 | 1,141 | CC0-1.0 | Oct 5 | Oct 14 |
| zenml-io/zenml | ZenML : One AI Platform from Pipelines to Agents. | Python | 5,616 | 663 | Apache-2.0 | Oct 14 | Oct 14 |
| microsoft/aici | AICI: Prompts as (Wasm) Programs | Rust | 2,077 | 86 | MIT | Jan 22, 2025 | Oct 11 |
| jwuthri-cloud/Tracely-ai | Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable. | Python | 1,166 | 146 | MIT | Oct 19 | Oct 21 |
| langfuse/mcp-server-langfuse | Model Context Protocol (MCP) Server for Langfuse Prompt Management. This server allows you to access and manage your Langfuse prompts through the Model Context Protocol. | TypeScript | 176 | 37 | MIT | Feb 16, 2025 | Oct 14 |
| krzko/google-cloud-mcp | A Model Context Protocol (MCP) server for Google Cloud (GCP) | TypeScript | 80 | 21 | Apache-2.0 | Dec 15, 2025 | Oct 14 |
| architsharm/agentfox | AgentFox: open-source control plane for AI agents. Guardrails on model traffic, tool calls bounded by capability grants, and a tamper-evident audit trail mapped to compliance… | Python | 3 | 2 | Apache-2.0 | Oct 14 | Oct 14 |
| valteresj2/agent-hangar | One home for every AI agent. Build, test and ship agents once, then use them from Claude, ChatGPT, Codex, Cursor, VS Code or Slack (MCP, OpenAI-compatible, A2A, ACP). Self-hosted… | Python | 3 | 2 | Apache-2.0 | Oct 14 | Oct 14 |
By language
- Python 7
- TypeScript 4
Related topics
- LLM 10
- MCP 6
- LangChain 5
- OpenAI 5
- LLM evaluation 4
- Prompt engineering 4
- AI agents 4
- Self hosted 3
- AI gateway 2
- Anthropic 2
- Gateway 2
- MCP gateway 2
Read from GitHub by SpecStream between October 11, 2026 and October 21, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.