Crawl

Roadmap

What’s shipped, what’s in beta, and what’s next for Crawl.

Status
Public Beta Wayback snapshots AI Tools
Latest update
Added Evolution tracker to AI Tools.
Oct 12, 2025
Links
Open Browser

AI Tools

BETA

Open any snapshot, then tap the menu (☰) → AI Tools.

Summarize this page

Extracts title, bullets, key points, entities and dates from the current capture.

Server: summarize.php Uses: text extraction

Popularity predictor

Heuristic score using on-page signals (links, images, social, keywords).

Server: popularity.php Signals-based

Evolution tracker

NEW

Compares two archived snapshots (earliest per chosen years) and highlights changes to content, layout/structure, and SEO elements (title, canonicals, H1/H2/H3, schema types, outbound hosts).

  • Side-panel UI with year pickers (From → To) and one-click Swap.
  • Textual diff (truncated) with add/remove highlighting.
  • Structural deltas (tag counts), heading changes, and schema deltas.
Client: diff-match-patch Server: fetch_snapshot_html.php Wayback-safe fetch

How it works

  1. Fetch snapshots via fetch_snapshots.php (Wayback CDX) and populate Year dropdown.
  2. Evolution tracker selects earliest captures for the chosen years.
  3. Server fetch (fetch_snapshot_html.php) returns HTML for each capture (Wayback id_ mode).
  4. Client strips archive UI/scripts, extracts text + SEO, then runs a semantic diff for content and computes structure deltas.

Changelog

Oct 12, 2025
Evolution tracker added to AI Tools panel (menu ☰ → AI Tools → Evolution tracker). Includes year pickers, HTML fetcher, text diff, heading/schema/link host deltas.
Sep 2025
Introduced Popularity predictor and Summarize features.
Initial Beta
Wayback year-jump browser with earliest-per-year capture loading.

Upcoming

Planned