A newly updated URL analyser checks robots.txt, sitemaps, noindex conditions, dead ends, schema and various AI-search signals in one audit.
Useful tooling, but it remains primarily a static crawl-readiness analyser.
It tells us what a machine could encounter, rather than measuring what a real search system actually encountered and did next.
