Data / Repositories / Webscraping / Python
Python Webscraping repositories on GitHub: 16 ranked by stars
16 public Python repositories tagged Webscraping are on GitHub, with 181,199 stars between them; 4 had a push in the last 30 days. The most starred: D4Vinci/Scrapling (86,357), ScrapeGraphAI/Scrapegraph-ai (31,623), assafelovic/gpt-researcher (30,095).
SpecStream is the live web data engine for teams and agents. It reads open-source repositories on GitHub and keeps what it reads, and this page groups that reading by topic. Ask for the repositories you track by topic, language, license or activity, and new ones and changes arrive in your sheet, CRM, Slack or agent.
Every repository, most starred first
| Repository | What it is | Stars | Forks | License | Last push | Read |
|---|---|---|---|---|---|---|
| D4Vinci/Scrapling | An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | 86,357 | 8,855 | BSD-3-Clause | Oct 8 | Oct 8 |
| ScrapeGraphAI/Scrapegraph-ai | Python scraper based on AI | 31,623 | 3,221 | MIT | Oct 6 | Oct 8 |
| assafelovic/gpt-researcher | An autonomous agent that conducts deep research on any data using any LLM providers | 30,095 | 4,128 | Apache-2.0 | Oct 10 | Oct 14 |
| seleniumbase/SeleniumBase | Browser automation, web scraping, and testing. CDP Mode provides a Stealthy Chromium instance that bypasses bot-detection systems. Includes an MCP server. | 13,031 | 1,588 | MIT | Sep 18 | Sep 21 |
| alirezamika/autoscraper | A Smart, Automatic, Fast and Lightweight Web Scraper for Python | 7,990 | 827 | MIT | Jul 29 | Sep 21 |
| feder-cr/invisible_playwright | Playwright anti-detect: automatically bypass captcha, anti-bot detection. Undetected Firefox fingerprint, stealth browser. Python web scraping automation, Cloudflare. | 2,949 | 285 | MIT | Sep 21 | Sep 21 |
| feder-cr/invisible_playwright_mcp | Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use. | 2,752 | 447 | MIT | Oct 13 | Oct 15 |
| zohaibbashir/Google-Maps-Scrapper | This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name… | 1,536 | 321 | MIT | May 18 | Sep 21 |
| raznem/parsera | Lightweight library for scraping web-sites with LLMs | 1,358 | 78 | GPL-2.0 | Dec 17, 2025 | Sep 21 |
| scrapfly/scrapfly-scrapers | Scalable Python web scraping scripts for +40 popular domains | 1,083 | 205 | Sep 18 | Sep 21 | |
| ScrapeGraphAI/scrapecraft | AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph. | 699 | 112 | MIT | Dec 26, 2025 | Sep 21 |
| jpjacobpadilla/Stealth-Requests | Undetected web-scraping & seamless HTML parsing in Python! | 564 | 57 | MIT | Sep 19 | Sep 21 |
| lkuffo/web-scraping | Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup | 393 | 213 | GPL-3.0 | Oct 20, 2025 | Sep 21 |
| oxylabs/Python-Web-Scraping-Tutorial | In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex. | 305 | 35 | Sep 24, 2025 | Sep 21 | |
| Clueless-Community/scrape-up | A web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website. | 253 | 228 | MIT | Aug 6, 2024 | Sep 21 |
| nuhmanpk/WebScrapper | Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands! | 211 | 116 | MIT | Mar 19 | Sep 21 |
Other languages
Related topics
- Web scraping 17
- Python 13
- Scraping 12
- Crawler 10
- Data extraction 7
- Playwright 7
- AI 6
- Scraper 6
- Automation 6
- Web crawler 5
- LLM 4
- Web scraper 4
Read from GitHub by SpecStream between September 21, 2026 and October 15, 2026; each row shows the day its repository was read. Stars and pushes change every day, and the GitHub page is the current one. Forks and archived repositories are left out.