OS
OSRepos
HomeRepositoriesTopicsRisingWatchlistCompareBlogRSS
Home/Topics/Web Crawling

Web Crawling Open Source Projects

Discover 1 open source Web Crawling repository from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Web Crawling projects here are most often combined with Framework, Library and Python. Last updated October 8, 2026.

NewestHealthiestHow the score works
Scrapling: Scrape and Crawl Websites with Python

Scrapling: Scrape and Crawl Websites with Python

Scrapling is a Python framework for extracting data from static and dynamic websites, with selectors that can adapt to page changes and tools for scaling from individual requests to concurrent crawls. It also offers browser-based fetching, a CLI, and an MCP server.

ActiveHealth 57/100

PythonLibraryFramework
Added Oct 11, 2025 View details

Related topics

Framework 93Library 291Python 639Web Scraping 31
OS
OSRepos

Analysis and discovery of open source repositories. Find interesting projects and follow their updates.

Follow OSRepos

BlueskyMastodonThreadsTelegramXYouTube
Monitor your website with YourWebsiteScore

Navigation

HomeRepositoriesSitemapRSS Feedllms.txtllms-full.txt

Legal

How OSRepos worksHow we measure healthPrivacy PolicyCookie Policy[email hidden]

Third-party code is used at your own risk.

© 2025 OSRepos. Built with Nuxt 3 and lots of ❤️

🍪

Help us find more projects you'll like

With analytics cookies (Google Analytics) we see which projects and pages are useful, so we can add more of what you like. No data sold. You can change your choice any time in Cookie Settings at the bottom of the page. Cookie Policy