Quickstart

Install

pip install wayparam

Install (from source)

From the repository root (where pyproject.toml lives):

python -m venv .venv
# Windows: .venv\Scripts\activate
# macOS/Linux: source .venv/bin/activate
python -m pip install -U pip
pip install -e .

Run

Single domain (writes to results/)

wayparam -d example.com

Multiple domains

wayparam -l domains.txt

Stream to stdout (no files)

wayparam -d example.com --stdout --no-files

JSONL output (better for automation)

wayparam -d example.com --stdout --no-files --format jsonl

wayparam -d example.com --rps 1 --concurrency 2

Query Common Crawl

wayparam -d example.com --source commoncrawl

Merge Wayback and Common Crawl

wayparam -d example.com --source wayback,commoncrawl

Use JSONL if you want the source field for provenance:

wayparam -d example.com --source wayback,commoncrawl --stdout --no-files --format jsonl

Historical endpoint intelligence

wayparam -d example.com --history --stdout --no-files --format jsonl

Historical parameter prevalence

wayparam -d example.com --params

One historical summary per domain

wayparam -l domains.txt --summary --format jsonl

Notes about output

  • stdout is reserved for machine-readable results only when --stdout is enabled.
  • logs, hints and optional stats go to stderr to keep pipelines clean.

Example safe pipeline:

wayparam -d example.com --stdout --no-files | sort -u > urls.txt