Data / Repositories / Scraper
Scraper repositories on GitHub: 24 ranked by stars
24 public repositories tagged Scraper are on GitHub, with 378,546 stars between them; 4 had a push in the last 30 days. Most are written in Python (11), Go (5), TypeScript (3). The most starred: firecrawl/firecrawl (191,485), unclecode/crawl4ai (85,530), apify/crawlee (25,860).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Language | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|---|
| firecrawl/firecrawl | Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. | TypeScript | 191,485 | 10,124 | AGPL-3.0 | Oct 14 | Oct 14 |
| unclecode/crawl4ai | Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. | Python | 85,530 | 8,879 | Apache-2.0 | Oct 14 | Oct 14 |
| apify/crawlee | Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML… | TypeScript | 25,860 | 1,677 | Apache-2.0 | Sep 21 | Sep 21 |
| Evil0ctal/Douyin_TikTok_Download_API | 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。| Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for… | Python | 20,637 | 2,881 | Apache-2.0 | Oct 2 | Oct 14 |
| apify/crawlee-python | Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files… | Python | 9,542 | 809 | Apache-2.0 | Sep 21 | Sep 21 |
| alirezamika/autoscraper | A Smart, Automatic, Fast and Lightweight Web Scraper for Python | Python | 7,990 | 827 | MIT | Jul 29 | Sep 21 |
| BruceDone/awesome-crawler | A collection of awesome web crawler,spider in different languages | 7,327 | 752 | MIT | Jun 16, 2024 | Oct 11 | |
| go-rod/rod | A Chrome DevTools Protocol driver for web automation and scraping. | Go | 7,109 | 484 | MIT | Aug 11 | Sep 21 |
| niespodd/browser-fingerprinting | Analysis of Bot Protection systems with available countermeasures . How to defeat anti-bot system and get around browser fingerprinting scripts when scraping the web? | JavaScript | 5,140 | 275 | Jul 27 | Sep 21 | |
| Anakin-Inc/anakin | Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up | Go | 4,403 | 181 | AGPL-3.0 | Aug 18 | Sep 21 |
| aapatre/Automatic-Udemy-Course-Enroller-GET-PAID-UDEMY-COURSES-for-FREE | Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY… | Python | 3,292 | 560 | GPL-3.0 | Apr 28 | Sep 21 |
| geziyor/geziyor | Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering. | Go | 2,778 | 155 | MPL-2.0 | Jul 2 | Sep 21 |
| cyberagiinc/DevDocs | Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code… | TypeScript | 2,107 | 200 | Apache-2.0 | Feb 4 | Oct 14 |
| elixir-crawly/crawly | Crawly, a high-level web crawling & scraping framework for Elixir. | Elixir | 1,117 | 125 | Apache-2.0 | Jul 16, 2025 | Sep 21 |
| scrapfly/scrapfly-scrapers | Scalable Python web scraping scripts for +40 popular domains | Python | 1,083 | 205 | Sep 18 | Sep 21 | |
| JosephLai241/URS | Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool. | Python | 1,036 | 126 | MIT | Jul 11 | Oct 11 |
| slotix/dataflowkit | Extract structured data from web sites. Web sites scraping. | Go | 713 | 82 | BSD-3-Clause | Mar 7, 2023 | Sep 21 |
| sangaline/advanced-web-scraping-tutorial | The Zipru scraper developed in the Advanced Web Scraping Tutorial. | Python | 426 | 93 | Mar 19, 2017 | Sep 21 | |
| C5H12O5/syno-videoinfo-plugin | A simple web scraping plugin for Synology Video Station | Python | 348 | 31 | Apache-2.0 | May 21 | Sep 21 |
| nuhmanpk/WebScrapper | Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands! | Python | 211 | 116 | MIT | Mar 19 | Sep 21 |
| umbrellaDocumentation/Web-Data-Scraper | Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook. | JavaScript | 133 | 116 | Mar 17 | Sep 21 | |
| codingforentrepreneurs/Web-Scraping | Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be… | Python | 117 | 65 | MIT | Dec 14, 2018 | Sep 21 |
| jadkins89/Recipe-Scraper | A JS package for scraping recipes from the web. | JavaScript | 102 | 52 | MIT | Dec 25, 2023 | Sep 21 |
| ejfkdev/dj | dj - Dynamic JS File Extractor - intelligently detects dynamically loaded JavaScript files by statically analyzing website HTML and JS code | Go | 60 | 4 | MPL-2.0 | Sep 28 | Oct 14 |
By language
- Python 11
- Go 5
- TypeScript 3
- JavaScript 3
Related topics
- Crawler 13
- Web scraping 12
- Scraping 11
- Python 9
- Web crawler 8
- Webscraping 6
- Automation 6
- Crawling 6
- Playwright 5
- Spider 5
- Go 5
- AI 4
Read from GitHub by SpecStream between September 21, 2026 and October 14, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.