AISchemaGenAuditBot
The checker behind AI Schema Gen's website audits. If you saw this name in your logs, this page explains what it was doing and how to allow or block it.
What it does
AISchemaGenAuditBot reads a sample of a website's pages to check how well AI answer engines and search engines can understand them: whether the pages can be reached, whether their structured data (schema.org markup) is present and valid, and how clearly the content is laid out. The result is a report for the person who asked for the check. See our scoring method for exactly what is measured.
It does not collect content to train AI models, does not fill in forms, does not log in anywhere, and does not follow links off the site it was asked to check.
When it visits
Only when a person asks for a check of that website: someone running our AI readiness checker, a customer checking their own site from their dashboard, or a scheduled re-check a customer has set up for a site they connected to their account. It does not roam the web looking for sites.
How to recognise it
Every request carries this user agent:
AISchemaGenAuditBot/1.0 (+https://aischemagen.com/audit-bot)
Requests are also signed using Web Bot Auth (HTTP Message Signatures), so services like Cloudflare can confirm a request really came from us and not from someone borrowing the name. Our public keys are published here:
https://api.aischemagen.com/.well-known/http-message-signatures-directory
Most requests come from our servers. If a site refuses our servers' address, the same signed request may be tried once more through Cloudflare's network, under the same name.
robots.txt and pace
The checker reads your robots.txt before it looks at any pages and skips every page your rules disallow for AISchemaGenAuditBot, or for all bots (User-agent: *) when there is no group for us by name. It still opens robots.txt itself, llms.txt, your sitemap and your home page, to find out which pages exist.
It waits at least 0.3 seconds between page loads, and longer if your robots.txt sets a Crawl-delay. A free check opens up to 100 pages, spread across the site.
To block it completely, add this to your robots.txt:
User-agent: AISchemaGenAuditBot Disallow: /
Allowing it through a firewall
If a check of your own site reported that it was turned away, a firewall or security setting is blocking automated visitors. Allow requests whose user agent contains AISchemaGenAuditBot, or, on Cloudflare, allow verified bots, then run the check again.
Contact
Questions or problems with the checker? Email support@aischemagen.com and include the website and roughly when you saw the visit.