Checks whether your robots.txt blocks known AI answer-engine crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether you have an llms.txt — the emerging standard for giving AI systems a curated summary of your site.
Checks robots.txt against a maintained list of named AI-crawler user agents, not just a generic disallow check.
Clearly distinguishes an intentional AI-crawler block from an accidental one — never assumes bad intent.
llms.txt presence check for the emerging AI-content-summary convention.