The reading room · 41 guides
Guides, written answer-first
Everything we know about making sites visible to AI search — each guide practices the structure it preaches and links to the matching tools.
These guides cover the full generative engine optimization stack: how AI crawlers like GPTBot and ClaudeBot discover your site, what the llms.txt standard actually does, which structured data still matters for AI search, and how to write content that gets cited by ChatGPT, Perplexity, and Google AI Overviews instead of silently summarized. If you're new, start with the fundamentals category, then work through crawling and content structure — each guide ends with the free tool that puts it into practice.
AI Crawling & Access / 19
- Does ChatGPT read robots.txt? And other AI crawler questions, answered
- List of AI crawlers and their user agents
- Should you block AI crawlers? Trade-offs explained
- What is llms.txt? Spec, examples, and how to create one
- How to check if AI bots are crawling your site
- llms.txt vs robots.txt vs sitemap.xml: what each file does
- Technical SEO for AI crawlers: sitemaps, redirects, and hreflang
- Do AI crawlers read JavaScript? What GPTBot & friends actually see
- Google-Extended explained: what it controls (and what it doesn't)
- How to add llms.txt to WordPress (3 methods, no plugin required)
- How to block ChatGPT from crawling your website (and what actually happens)
- llms.txt examples: real files from real sites, annotated
- llms.txt vs llms-full.txt: which one do you need?
- How to add llms.txt to Shopify (3 working methods)
- How to add llms.txt to Webflow (what works and what doesn't)
- How to add llms.txt to Squarespace (URL mapping method)
- llms.txt on Wix: automatic generation and how to check yours
- How to add llms.txt to Next.js (static file or dynamic route)
- How to add llms.txt to Framer (native support + fallbacks)
Structured Data / 5
GEO Fundamentals / 6
- GEO vs SEO vs AEO: definitions and what actually changed
- How to get your website cited by ChatGPT
- Why isn't my site showing up in ChatGPT answers?
- The AI search optimization checklist: 20 checks before you publish
- The best free GEO tools in 2026 (by job, not by hype)
- How to optimize your site for Perplexity: getting cited by the answer engine
Content Structure / 3
Auditing / 2
Technical SEO / 6
- 301 vs 302 redirects: which one to use (and when it matters)
- Do you need an XML sitemap in 2026? (Yes — here's why and when)
- Hreflang tags explained: syntax, examples, and common mistakes
- Meta description length: how long should it be in 2026?
- Link preview not showing? How to fix Open Graph tags that won't render
- Open Graph image size: the correct dimensions in 2026