ProtocolProbe - Standards & Protocol Profiler

This site tests how crawlers handle standard HTTP protocols, redirects, caching headers, canonical tags, robot directives, and honeypot traps.

Protocol Tests

XML Sitemap

sitemap.xml — Valid XML sitemap with ~20 pages, varying priority and lastmod

HTTP Redirects

/redirect/301 — 301 Permanent Redirect
/redirect/302 — 302 Found Redirect
/redirect/307 — 307 Temporary Redirect
/redirect/308 — 308 Permanent Redirect
/redirect/chain — Multi-hop chain: 301 → 302 → 307 → destination
/redirect/destination — Final redirect destination

Non-HTTP Redirects

/redirect/meta — HTML meta http-equiv refresh redirect
/redirect/js — JavaScript window.location redirect

Canonical Tags

/canonical — Page with rel=canonical pointing to /canonical-target
/canonical-target — The canonical target page

Robot Directives

/nofollow — Page with rel=nofollow links
/nofollow/target-a — Nofollow target A
/nofollow/target-b — Nofollow target B
/noindex — Page with meta robots noindex
/noindex/linked — Page linked from noindex page

Caching & Conditional Requests

/etag — ETag header with 304 support
/last-modified — Last-Modified header with 304 support

Honeypot Traps

/honeypot — Page with hidden links to detect bots