Technical SEO and AI search readiness: the complete audit checklist
A deep technical audit for Google, ChatGPT, Claude and Perplexity: crawler access, indexability, rendering, snippet controls, structure and measurement.
Blog / AI Search
How AI Overviews, ChatGPT, Claude and Perplexity find, read and cite web pages, and what you control: which AI crawlers you allow, content that only appears after JavaScript, snippet and opt-out controls, llms.txt, and how to measure AI search traffic. 11 articles.
A deep technical audit for Google, ChatGPT, Claude and Perplexity: crawler access, indexability, rendering, snippet controls, structure and measurement.
A cautious technical audit for Perplexity visibility: PerplexityBot, user-triggered fetches, WAF access, readable pages and citation checks.
How AI agents read and use web pages, and what web.dev recommends so they can complete tasks: semantic HTML, labels, visible controls and stable layouts.
Where AI search traffic shows up in Search Console, GA4 and server logs, which visits each one misses, and how to build a simple view of AI visibility.
What Bing recommends for its search and AI-powered answers: accurate sitemaps and lastmod, IndexNow for fast updates, and controls for AI answers.
Every major AI crawler and its purpose, robots.txt rules to opt out of AI training but stay in AI search answers, and what robots.txt can't stop.
What OpenAI says about getting into ChatGPT search, the crawler that matters, how to opt out, how to track ChatGPT traffic and what to check on your site.
How Claude finds and cites web pages, what its search and user-fetch bots do, and how to check whether your site is accessible and useful as a source.
What Google says decides which pages AI Overviews and AI Mode cite, what makes a page eligible, which AEO and GEO tactics you can ignore, and how to measure it.
What the llms.txt proposal is, the exact file format, what Google says about it, where it's genuinely useful, and how to write and maintain one.
Crawl, audit 70 checks, and line them up with Search Console and Core Web Vitals data.
Download free for Windows