Data / Repositories / LLM / Rust
Rust LLM repositories on GitHub: 35 ranked by stars
35 public Rust repositories tagged LLM are on GitHub, with 303,653 stars between them; 25 had a push in the last 30 days. The most starred: rtk-ai/rtk (82,881), janhq/jan (44,943), tinyhumansai/openhuman (41,979).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|
| rtk-ai/rtk | CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies | 82,881 | 5,258 | Apache-2.0 | Oct 9 | Oct 11 |
| janhq/jan | Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 44,943 | 3,097 | Oct 14 | Oct 14 | |
| tinyhumansai/openhuman | The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS. | 41,979 | 4,131 | GPL-3.0 | Oct 14 | Oct 14 |
| screenpipe/screenpipe | YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context | 21,938 | 2,243 | Oct 14 | Oct 14 | |
| 1jehuang/jcode | High performance coding agent harness written in rust | 20,388 | 2,374 | MIT | Oct 11 | Oct 11 |
| sigoden/aichat | All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more. | 10,491 | 748 | Apache-2.0 | Feb 23 | Oct 11 |
| astrid-runtime/astrid | Astrid is a portable, capability-secure operating system for composable software. | 10,280 | 142 | Apache-2.0 | Oct 10 | Oct 11 |
| Nasiko-Labs/nasiko | The Open Runtime for AI Agents | 9,490 | 2,053 | Oct 7 | Oct 14 | |
| deeplethe/utopia | World's first open-source enterprise world model. | 8,349 | 1,155 | Apache-2.0 | Oct 14 | Oct 14 |
| EricLBuehler/mistral.rs | Fast, flexible LLM inference | 7,737 | 727 | MIT | Oct 1 | Oct 11 |
| mufeedvh/code2prompt | A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting. | 7,722 | 456 | MIT | Sep 25 | Oct 11 |
| tailcallhq/forgecode | AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models | 7,638 | 1,462 | Apache-2.0 | Oct 14 | Oct 14 |
| yvgude/lean-ctx | LeanCTX — Context Gateway for AI Systems. Control what your AI can see. Open-source Engine for context selection, supported controls, and evidence. | 3,878 | 353 | Apache-2.0 | Oct 14 | Oct 14 |
| moltis-org/moltis | A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure… | 2,888 | 358 | MIT | Sep 22 | Oct 14 |
| devflowinc/trieve | All-in-one platform for search, recommendations, RAG, and analytics offered via API | 2,717 | 254 | MIT | Jan 25 | Oct 11 |
| Pinvou/pinvou-agent | Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables. | 2,493 | 368 | MIT | Oct 14 | Oct 14 |
| 0xMassi/webclaw | Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | 2,380 | 238 | AGPL-3.0 | Oct 14 | Oct 14 |
| tensorchord/pgvecto.rs | Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database. | 2,190 | 86 | Apache-2.0 | Feb 26, 2025 | Oct 11 |
| microsoft/aici | AICI: Prompts as (Wasm) Programs | 2,077 | 86 | MIT | Jan 22, 2025 | Oct 11 |
| shiwenwen/hope-agent | A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手，也可服务化常驻 NAS / 云端 | 1,801 | 166 | MIT | Oct 10 | Oct 11 |
| RunanywhereAI/wally | Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models. | 1,562 | 93 | MIT | Oct 10 | Oct 11 |
| Abraxas-365/langchain-rust | LangChain for Rust, the easiest way to write LLM-based programs in Rust | 1,349 | 174 | MIT | Oct 8 | Oct 11 |
| yfedoseev/pdf_oxide | The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass… | 1,073 | 133 | Apache-2.0 | Oct 6 | Oct 11 |
| us/crw | Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl… | 1,059 | 84 | AGPL-3.0 | Sep 21 | Sep 21 |
| SylphxAI/anymd | Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB, HTML and web pages, images (OCR), audio and video (metadata, subtitles, transcripts). A fast Rust MCP… | 1,033 | 90 | MIT | Oct 10 | Oct 11 |
| hyper-mcp-rs/hyper-mcp | A fast, secure MCP server that extends its capabilities through WebAssembly plugins. | 883 | 66 | Apache-2.0 | Oct 13 | Oct 14 |
| genomoncology/biomcp | BioMCP: Biomedical Model Context Protocol | 654 | 117 | MIT | Oct 14 | Oct 14 |
| second-state/echokit_server | Open Source Voice Agent Platform | 592 | 78 | GPL-3.0 | Feb 15 | Oct 14 |
| strands-agents/box | Run AI agents in a sandbox that restricts what they can execute, read, write, and reach on the network. Box combines OS isolation with default-deny Dogwood policies and credential… | 450 | 29 | Apache-2.0 | Oct 21 | Oct 21 |
| Govcraft/rust-docs-mcp-server | Prevents outdated Rust code suggestions from AI assistants. This MCP server fetches current crate docs, uses embeddings/LLMs, and provides accurate context via a tool call. | 299 | 39 | MIT | Nov 24, 2025 | Oct 14 |
| gbrigandi/mcp-server-wazuh | MCP Server for Wazuh SIEM | 239 | 61 | MIT | Dec 12, 2025 | Oct 14 |
| major7apps/pensyve | Universal memory runtime for AI agents | 96 | 16 | Oct 8 | Oct 14 | |
| vakandi/opencode-rust | The open source AI coding agent, in Rust. CLI, TUI and HTTP server for local AI agents — no Docker required. | 73 | 1 | MIT | Oct 16 | Oct 21 |
| EmilLindfors/mcp | A crate for making MCP (Model Context Protocol) compatible programs with rust | 18 | 10 | Dec 3, 2024 | Oct 14 | |
| ModernOps888/mcplex | MCPlex - The MCP Smart Gateway. Semantic tool routing, security guardrails, and real-time observability for AI agents. | 13 | 2 | MIT | Oct 14 | Oct 14 |
Other languages
- Python 182
- TypeScript 115
- Go 20
- JavaScript 18
- C++ 6
- Java 5
- HTML 4
- C# 4
- Swift 4
Related topics
- MCP 273
- AI 208
- MCP server 152
- AI agents 144
- Model Context Protocol 109
- Claude 103
- Agents 100
- Python 77
- Claude Code 65
- TypeScript 64
- Developer tools 53
- Anthropic 50
Read from GitHub by SpecStream between September 21, 2026 and October 21, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.