jaypyles

Scraperr: Scrape Websites Without Writing Code

Scraperr is a self-hosted web scraping application for collecting structured data from websites without writing scraping code. It supports XPath extraction, domain spidering, queued jobs, media downloads, and data export.

View on GitHub Compare
Stars
4.9k
Forks
250
Stars, last 30 days
-2

Our take

Health score

21/100

How it is scored
Activity
19
Community
24
Issues
21
Pull requests
20

-2 stars in the last 30 days

Project history

Daily GitHub snapshots since Oct 7, 2026. History covers stars and forks; health signals are not tracked historically.

Selected snapshot

Stars

4,909

Forks

252

Change since Nov 14, 2026: 0 stars·0 forks

Overview

Scraperr is a self-hosted web scraping application for people who need to collect website data without building scrapers by hand. Its interface lets users define XPath-based extraction and manage scraping jobs, with options such as crawling pages on the same domain and downloading media.

It is suited to individuals and teams who want to run scraping on their own infrastructure and review or export results through a web interface. The project provides Docker and Helm deployment paths. See the official repository and documentation for setup details.

Key Features

  • Target page elements using XPath-based extraction.
  • Queue and manage multiple scraping jobs.
  • Spider pages within the same domain.
  • Add custom JSON headers to requests.
  • Download images, videos, and other media.
  • View results in a structured table and export them as Markdown or CSV.
  • Send notifications when jobs complete.

Use Cases

  • Researchers can collect permitted website content for analysis without writing a custom scraper.
  • Small teams can schedule and manage multiple scraping tasks through a shared web application.
  • Site auditors can crawl pages within a domain and extract selected fields for review.
  • Users gathering public media can download page images, videos, and other media alongside extracted data.

Getting Started

With Docker, run:

make up

For Helm deployment and further setup instructions, see the documentation and README.

Alternatives

  • deepscrape: DeepScrape is an API-oriented crawling service with browser rendering and optional LLM extraction, while Scraperr offers a self-hosted visual scraping workflow.
  • AnyCrawl: AnyCrawl is a developer toolkit for URL batches and LLM extraction, while Scraperr is a self-hosted application with XPath extraction and queued jobs.
  • firecrawl: Firecrawl provides an API for crawling sites and returning AI-ready content, while Scraperr focuses on self-hosted scraping jobs and media downloads.
  • Scrapling: Scrapling is a Python library with adaptive scraping and anti-bot features, while Scraperr is a self-hosted application for no-code extraction and job management.
ProjectLanguageLicenseStarsStatus
ScraperrTypeScriptMIT4.9kNot checked yet
deepscrapeTypeScriptMIT320Active
AnyCrawlTypeScriptMIT3.5kActive
firecrawlTypeScriptAGPL-3.0188kActive
ScraplingPythonBSD-3-Clause86.2kActive

Considerations

  • The repository is archived, so users should account for the possibility that fixes and maintenance may not continue.
  • Deployment requires running the application on infrastructure you manage. The README documents Docker and Helm paths; consult the project docs for requirements and configuration.
  • Scraping is subject to site rules. The project advises checking robots.txt, respecting terms of service, and using reasonable request delays. Use it only on sites that permit scraping.

Found this useful?

Share it with someone who would like Scraperr.

Comparisons