The four groups
| Group | What it checks |
|---|---|
| Access | Whether the page loads without errors, uses HTTPS, can be indexed, allows search and AI crawlers in robots.txt, has a sitemap and an llms.txt, and responds quickly. |
| Content | Title, description, a single H1, readable text, declared language, mobile readiness and sharing tags. |
| Data | Brand identification with Organization or LocalBusiness schema, and FAQs marked up with FAQPage. |
| Topics | Whether the site has pages dedicated to the topics you track. |
How to use the result
Each check shows its status (pass, warning or issue) and the suggested fix. Start with the issues in the Access group: if AI crawlers can’t read your site, the other improvements will have little effect.
Training crawlers and search crawlers
The diagnostic separates crawlers that look for answers in real time from those that collect data to train models. You can block training crawlers without losing visibility in answers, as long as search crawlers stay allowed.
You can check any site’s robots.txt with the free checker.
Go from theory to numbers.
See how AI talks about your brand on every topic.