Data / Repositories / Web search
Web search repositories on GitHub: 9 ranked by stars
9 public repositories tagged Web search are on GitHub, with 294,249 stars between them; 5 had a push in the last 30 days. Most are written in Python (5), TypeScript (3), Rust (1). The most starred: firecrawl/firecrawl (191,485), mvanhorn/last30days-skill (64,215), ScrapeGraphAI/Scrapegraph-ai (31,623).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Language | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|---|
| firecrawl/firecrawl | Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. | TypeScript | 191,485 | 10,124 | AGPL-3.0 | Oct 14 | Oct 14 |
| mvanhorn/last30days-skill | AI agent skill that researches any topic across Reddit, X, YouTube, HN, Polymarket, and the web - then synthesizes a grounded summary | Python | 64,215 | 5,605 | MIT | Oct 13 | Oct 14 |
| ScrapeGraphAI/Scrapegraph-ai | Python scraper based on AI | Python | 31,623 | 3,221 | MIT | Oct 6 | Oct 8 |
| exa-labs/exa-mcp-server | Exa MCP for web search and web crawling! | TypeScript | 5,127 | 403 | MIT | Oct 7 | Oct 14 |
| mrkrsl/web-search-mcp | A simple, locally hosted Web Search MCP server for use with Local LLMs | TypeScript | 1,180 | 161 | MIT | Aug 8, 2025 | Oct 14 |
| Shelpuk-AI-Technology-Consulting/kindly-web-search-mcp-server | Kindly Web Search MCP Server: Web search + robust content retrieval for AI coding tools (Claude Code, Codex, Cursor, GitHub Copilot, Gemini, etc.) and AI agents (Claude Desktop… | Python | 399 | 34 | MIT | Oct 10 | Oct 14 |
| MiniMax-AI/MiniMax-Coding-Plan-MCP | Specialized MiniMax Model Context Protocol (MCP) server designed for coding-plan users, featuring AI-powered search and vision analysis APIs optimized for code development… | Python | 101 | 31 | MIT | Aug 20 | Oct 14 |
| lispking/ferris-search | A blazing-fast MCP (Model Context Protocol) server for multi-engine web search, written in Rust. | Rust | 61 | 17 | Apache-2.0 | Apr 6 | Oct 14 |
| MiniMax-AI/minimax_search | MiniMax Search is an MCP (Model Context Protocol) server that provides web search and browsing capabilities. | Python | 58 | 13 | Nov 3, 2025 | Oct 14 |
By language
- Python 5
- TypeScript 3
Related topics
- MCP 5
- MCP server 4
- LLM 3
- AI 2
- AI agents 2
- Crawler 2
- Data extraction 2
- Markdown 2
- Scraping 2
- Web crawler 2
- Web scraper 2
- Web scraping 2
Read from GitHub by SpecStream between October 8, 2026 and October 14, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.