trafilatura vs python-readability
Web page text extraction compared
trafilatura and python-readability both extract readable article content from HTML and can support content-processing workflows. trafilatura covers discovery, downloading, structured metadata, and multiple export formats, while python-readability focuses on returning a document's main content as cleaned-up HTML.
trafilatura: Extract Text and Metadata from Web Pages
Trafilatura is a Python library and CLI for discovering web content and extracting readable text and metadata from HTML. It suits developers and researchers building crawlers, web corpora, or content-processing pipelines that need structured output.
python-readability: Extract Main Text from HTML Pages
python-readability extracts an article’s main text and title from an HTML document, reducing navigation and other page clutter. It is a Python library for applications that need readable page content, with a command-line option for local files and URLs.
| trafilatura | python-readability | |
|---|---|---|
| Language | Python | HTML |
| License | Apache-2.0 | Apache-2.0 |
| Stars | 6.9k | 2.9k |
| Forks | 447 | 352 |
| Last analyzed | Oct 3, 2026 | Oct 3, 2026 |
Key differences
- trafilatura can discover URLs from sitemaps and feeds and manage download queues; python-readability offers extraction from HTML and a CLI for local files or URLs.
- trafilatura extracts metadata such as author, date, site name, categories, and tags, and can preserve document structures; python-readability centers on a title and main body, with options for article metadata and images.
- trafilatura exports to formats including TXT, Markdown, CSV, JSON, HTML, XML, and XML-TEI; python-readability returns article content as HTML through `Document.summary()`.
- trafilatura includes its own rule-based extractor with jusText and readability-lxml fallbacks; python-readability describes its extraction as heuristic and includes real-page fixtures and benchmark tooling.
- Both projects list the Apache-2.0 license. trafilatura is described as a Python library and CLI, while python-readability's supplied language fact is HTML.
Choose trafilatura if you…
- need URL discovery, downloading, and extraction in one workflow.
- want structured metadata and exports beyond HTML, including Markdown, JSON, or XML-TEI.
- need options for parallel processing, download queues, filtering, or deduplication.
Choose python-readability if you…
- need a focused way to extract a page title and main body as HTML.
- want a CLI for processing a local HTML file or URL, or an API for HTML content.
- need fixtures and benchmark tooling to compare page-extraction changes.
Compare the numbers side by side, or add more projects
This comparison is generated with AI from the OSRepos analyses of both projects. Always check each project's repository and documentation before choosing.