Skip to main content

2 docs tagged with "robots"

View all tags

Sitemap generation & coverage

Building and serving your own XML sitemap, submitting it to Search Console, tracking index coverage, and the reachability check that stops a dead sitemap URL being submitted to Google.

Technical health & indexability

The eight indexability buckets, crawl-regression incidents with deploy correlation, blast radius in clicks, SLA triage, and why a crawl of the wrong hostname makes every number on this page wrong.