xnl-h4ck3r

waymore: Find and Download Archived URLs

waymore collects historical URLs from web archives and threat-intelligence sources, and can download archived responses for further analysis. It is aimed at security researchers and bug bounty hunters who value broad coverage over speed.

View on GitHub Compare
Stars
2.8k
Forks
296
Stars, last 30 days
+29

Our take

Health score

29/100

How it is scored
Activity
47
Community
29
Issues
21
Pull requests
20

+29 stars in the last 30 days

  • Releases more often than 76% of the projects we track

Project history

Daily GitHub snapshots since Oct 7, 2026. History covers stars and forks; health signals are not tracked historically.

Selected snapshot

Stars

2,797

Forks

294

Change since Nov 17, 2026: +1 stars·0 forks

Overview

waymore is a Python command-line tool for discovering historical URLs across several public archive and intelligence services. It brings together sources such as the Wayback Machine, Common Crawl, AlienVault OTX, URLScan, VirusTotal, GhostArchive, and Intelligence X, helping security researchers gather results in one workflow.

Unlike URL-only discovery tools, waymore can also download archived responses from the Wayback Machine and URLScan. Those files can be searched for additional links, parameters, and developer comments. It is designed for coverage rather than speed, so it is most useful when a thorough historical review matters more than a quick scan.

Key Features

  • Retrieves URL data from multiple archive and intelligence sources, with options to exclude individual providers.
  • Downloads archived responses from the Wayback Machine and URLScan for offline inspection.
  • Supports domain, path, file, and standard-input targets, with subdomain handling for domain searches.
  • Filters results by date, HTTP status, MIME type, URL patterns, keywords, and capture interval.
  • Limits response downloads and requests, and can resume an incomplete response-download run.
  • Writes URL lists and response files to configurable locations, with optional streaming of discovered URLs to standard output.
  • Offers Docker usage and optional completion notifications through Discord or Telegram.

Use Cases

  • Bug bounty hunters can build a historical URL inventory for an in-scope domain before testing current endpoints.
  • Security researchers can inspect archived response files for old parameters, exposed comments, and additional links.
  • Recon workflows can send discovered URLs through standard output to downstream command-line tools.
  • Researchers comparing historical site content can restrict collection by dates, capture frequency, status codes, or content type.

Getting Started

Install with pip:

pip install waymore

See the README for configuration, provider access requirements, usage options, and Docker instructions.

Considerations

  • Collection can be slow, especially for large domains or sources that require many requests. The project prioritizes coverage over speed.
  • Provider rate limits and availability affect results and runtime. Some providers have access restrictions: Intelligence X requires an academic or paid tier for the described search, while URLScan recommends an API key and notes that rate limits may apply.
  • Response downloads can consume substantial time and disk space. The README recommends using filters, date bounds, capture intervals, and response limits where appropriate.
  • The README states that Python 3.7 or higher is required. Results depend on the coverage and capabilities of the external sources, and some sources cannot apply MIME-type filtering.

Found this useful?

Share it with someone who would like waymore.