Open Source Data Extraction Tools
Data extraction is the process of collecting useful information from websites, documents, feeds, and other sources, then turning it into a form that can be searched, analyzed, or used by software. It helps reduce manual copying and makes information from varied formats more consistent. Depending on the source, extraction may involve parsing page structure, handling dynamic content, recognizing text and tables, or converting records into structured formats for later use.
Open source tools in this area include web scrapers and crawlers, document and PDF parsers, feed readers, and libraries for extracting article text or metadata. When choosing one, consider supported formats and sites, output quality, reliability, maintenance activity, license, dependencies, and integration with your existing workflow. These tools are useful to developers, researchers, data teams, and organizations that need repeatable ways to gather and prepare information.
60 repositories · updated October 15, 2026
agenticschema: Turn Structured Web Data Into Agent Tools
AgenticSchema converts Schema.org data already present in web pages into tools for AI agents. It supports browser WebMCP registration and a Node MCP server, without requiring a new backend or page API.
NewHealth 44/100
xlrd: Read Data from Legacy Excel Files
xlrd is a Python library for reading cell data and formatting from legacy Excel .xls files. It suits scripts and applications that need to inspect older spreadsheets, but it does not read newer Excel formats such as .xlsx.
MaintainedHealth 40/100
pdfminer.six: Extract and Analyze Content from PDFs
pdfminer.six is a Python library and command-line tool for extracting and analyzing content from PDF files. Use it when you need text, layout details, images, or document structure from PDFs in a Python workflow.
QuietHealth 49/100
pdf-inspector: Classify PDFs and Extract Text as Markdown
pdf-inspector is a Rust library and set of bindings for classifying PDFs, extracting positioned text, and converting documents to Markdown. It helps processing pipelines route scanned pages to OCR while handling text-based pages locally.
ActiveHealth 59/100
awesome-skills: Community Skills for Apify Agents
A community collection of agent skills that guide AI coding assistants in using Apify Actors for tasks such as research, lead generation, and data collection. Install the collection with the skills CLI and use it with supported coding agents.
ActiveHealth 41/100
python-phonenumbers: Parse, Validate, and Format Phone Numbers
A Python port of Google’s libphonenumber for parsing, validating, and formatting international phone numbers. It also supports matching numbers in text and optional location, carrier, and timezone lookups.
ActiveHealth 45/100
lassie: Retrieve Structured Content from Websites
Lassie is a Python library that fetches basic content and metadata from web pages. It suits applications that need page titles, descriptions, images, video details, or other metadata without building their own extraction flow.
InactiveHealth 24/100
micawber: Extract Rich Content from URLs
micawber is a Python library for retrieving rich metadata from URLs and replacing links in text or HTML with embedded content. Use it when an application needs to turn supported links, such as video URLs, into rich previews.
ActiveHealth 48/100
requests-html: Fetch and Parse HTML in Python
requests-html combines familiar Requests-style HTTP access with HTML parsing tools for scraping. It supports CSS and XPath selection, link extraction, asynchronous requests, and optional Chromium rendering for JavaScript-generated content.
InactiveHealth 30/100
toapi: Turn Web Pages into JSON APIs
toapi converts web pages into JSON endpoints using declarative CSS selectors. It suits developers who need lightweight, on-demand data extraction without maintaining a separate crawler or database.
QuietHealth 28/100
grab: Build Python Web Scrapers and Crawlers
Grab is a Python framework for making HTTP requests, extracting data from HTML, and building concurrent crawlers. It suits developers who need reusable scraping workflows with request handling, task queues, and proxy support.
InactiveHealth 26/100
llama_cloud_services: Parse Documents and Use Llama Cloud Services
A TypeScript client and service repository for Llama Cloud document processing and knowledge workflows. It is deprecated; new projects should use the replacement packages linked by the maintainers.
QuietHealth 48/100