Data / Repositories / Web scraping / Rust
Rust Web scraping repositories on GitHub: 3 ranked by stars
3 public Rust repositories tagged Web scraping are on GitHub, with 6,208 stars between them; 2 had a push in the last 30 days. The most starred: spider-rs/spider (2,769), 0xMassi/webclaw (2,380), us/crw (1,059).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|
| spider-rs/spider | Foundational low latency web data collecting in Rust | 2,769 | 312 | MIT | Oct 1 | Oct 11 |
| 0xMassi/webclaw | Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | 2,380 | 238 | AGPL-3.0 | Oct 14 | Oct 14 |
| us/crw | Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl… | 1,059 | 84 | AGPL-3.0 | Sep 21 | Sep 21 |
Other languages
- Python 28
- TypeScript 7
- JavaScript 7
Related topics
- Python 23
- Crawler 20
- Scraping 19
- Webscraping 17
- AI agents 15
- Web crawler 15
- MCP server 15
- MCP 14
- Playwright 13
- Scraper 12
- AI 11
- Automation 11
Read from GitHub by SpecStream between September 21, 2026 and October 14, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.