Data / Repositories / Webscraping
Webscraping repositories on GitHub: 27 ranked by stars
27 public repositories tagged Webscraping are on GitHub, with 404,906 stars between them; 6 had a push in the last 30 days. Most are written in Python (16), TypeScript (3), JavaScript (3). The most starred: firecrawl/firecrawl (191,485), D4Vinci/Scrapling (86,357), ScrapeGraphAI/Scrapegraph-ai (31,623).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Language | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|---|
| firecrawl/firecrawl | Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. | TypeScript | 191,485 | 10,124 | AGPL-3.0 | Oct 14 | Oct 14 |
| D4Vinci/Scrapling | An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | Python | 86,357 | 8,855 | BSD-3-Clause | Oct 8 | Oct 8 |
| ScrapeGraphAI/Scrapegraph-ai | Python scraper based on AI | Python | 31,623 | 3,221 | MIT | Oct 6 | Oct 8 |
| assafelovic/gpt-researcher | An autonomous agent that conducts deep research on any data using any LLM providers | Python | 30,095 | 4,128 | Apache-2.0 | Oct 10 | Oct 14 |
| pystardust/ani-cli | A cli tool to browse and play anime | Shell | 13,964 | 888 | GPL-3.0 | Oct 5 | Oct 11 |
| seleniumbase/SeleniumBase | Browser automation, web scraping, and testing. CDP Mode provides a Stealthy Chromium instance that bypasses bot-detection systems. Includes an MCP server. | Python | 13,031 | 1,588 | MIT | Sep 18 | Sep 21 |
| lorien/awesome-web-scraping | List of libraries, tools and APIs for web scraping and data processing. | JavaScript | 8,153 | 948 | Sep 19 | Sep 21 | |
| alirezamika/autoscraper | A Smart, Automatic, Fast and Lightweight Web Scraper for Python | Python | 7,990 | 827 | MIT | Jul 29 | Sep 21 |
| niespodd/browser-fingerprinting | Analysis of Bot Protection systems with available countermeasures . How to defeat anti-bot system and get around browser fingerprinting scripts when scraping the web? | JavaScript | 5,140 | 275 | Jul 27 | Sep 21 | |
| feder-cr/invisible_playwright | Playwright anti-detect: automatically bypass captcha, anti-bot detection. Undetected Firefox fingerprint, stealth browser. Python web scraping automation, Cloudflare. | Python | 2,949 | 285 | MIT | Sep 21 | Sep 21 |
| feder-cr/invisible_playwright_mcp | Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use. | Python | 2,752 | 447 | MIT | Oct 13 | Oct 15 |
| TheWebScrapingClub/webscraping-from-0-to-hero | The web scraping open project repository aims to share knowledge and experiences about web scraping with Python | 1,737 | 110 | May 27, 2024 | Sep 21 | ||
| zohaibbashir/Google-Maps-Scrapper | This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name… | Python | 1,536 | 321 | MIT | May 18 | Sep 21 |
| raznem/parsera | Lightweight library for scraping web-sites with LLMs | Python | 1,358 | 78 | GPL-2.0 | Dec 17, 2025 | Sep 21 |
| ProxyShard/ShardBrowser | Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ProxyShard team. Engine-level fingerprint spoofing in Chromium 152 (WebGL / WebGPU /… | TypeScript | 1,107 | 126 | MIT | Sep 13 | Sep 21 |
| scrapfly/scrapfly-scrapers | Scalable Python web scraping scripts for +40 popular domains | Python | 1,083 | 205 | Sep 18 | Sep 21 | |
| ScrapeGraphAI/scrapecraft | AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph. | Python | 699 | 112 | MIT | Dec 26, 2025 | Sep 21 |
| adrianhajdin/pricewise | Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more. | TypeScript | 635 | 182 | Jul 6, 2024 | Sep 21 | |
| jpjacobpadilla/Stealth-Requests | Undetected web-scraping & seamless HTML parsing in Python! | Python | 564 | 57 | MIT | Sep 19 | Sep 21 |
| openaustralia/morph | Take the hassle out of web scraping | Ruby | 481 | 82 | AGPL-3.0 | Sep 17 | Sep 21 |
| davidteather/everything-web-scraping | Learn everything web scraping with David Teather Codes on YouTube | HTML | 478 | 87 | GPL-3.0 | Jul 31, 2023 | Sep 21 |
| yusuzech/r-web-scraping-cheat-sheet | Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium. | R | 394 | 99 | MIT | Dec 20, 2022 | Sep 21 |
| lkuffo/web-scraping | Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup | Python | 393 | 213 | GPL-3.0 | Oct 20, 2025 | Sep 21 |
| oxylabs/Python-Web-Scraping-Tutorial | In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex. | Python | 305 | 35 | Sep 24, 2025 | Sep 21 | |
| Clueless-Community/scrape-up | A web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website. | Python | 253 | 228 | MIT | Aug 6, 2024 | Sep 21 |
| nuhmanpk/WebScrapper | Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands! | Python | 211 | 116 | MIT | Mar 19 | Sep 21 |
| umbrellaDocumentation/Web-Data-Scraper | Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook. | JavaScript | 133 | 116 | Mar 17 | Sep 21 |
By language
- Python 16
- TypeScript 3
- JavaScript 3
Related topics
- Web scraping 17
- Python 13
- Scraping 12
- Crawler 10
- Data extraction 7
- Playwright 7
- AI 6
- Scraper 6
- Automation 6
- Web crawler 5
- LLM 4
- Web scraper 4
Read from GitHub by SpecStream between September 21, 2026 and October 15, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.