Open Source Web Scraping Tools
Discover 30 open source Web Scraping repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Web Scraping projects here are most often combined with Data Extraction, Python and TypeScript. Last updated October 4, 2026.
30 repositories · updated October 4, 2026
AnyCrawl: Crawl Websites and Extract LLM-Ready Data
AnyCrawl is a TypeScript toolkit for scraping individual pages, crawling sites, processing batches of URLs, and extracting structured data with LLMs. It suits developers building data pipelines for AI applications who need browser rendering or parallel processing.
sitefetch: Turn Website Content Into a Text File
sitefetch crawls a website and saves readable page content in a text file for use with AI models. It suits developers and researchers who need to collect site documentation or other web content for analysis.
maigret: Find a Person’s Accounts by Username
Maigret searches thousands of websites for accounts matching a username and gathers public profile information into reports. It is an OSINT tool for investigators, researchers, and developers who need to check username reuse across platforms.
Scrapling: Build Adaptive Web Scrapers and Crawlers
Scrapling is a Python framework for fetching, parsing, and crawling websites, with adaptive selectors that can relocate elements after page changes. It suits projects ranging from one-off extraction to concurrent crawls and AI-assisted scraping.
pipet: Scrape and Extract Data from the Web
Pipet is a command-line tool for extracting data from HTML pages, JSON endpoints, and JavaScript-rendered websites. It suits developers and technically minded users who want reusable scraping queries, shell-pipeline processing, or change monitoring.
stagehand: Build AI Agents That Use Websites
Stagehand is a browser automation SDK for AI agents, combining Playwright-style controls with natural-language actions and structured data extraction. It supports TypeScript, Python, and Go, and can run with a local browser or Browserbase.