{"industry":{"id":"70ea3802-1fc6-4fd7-a505-140d38d1c74a","slug":"digital-marketing","label":"Digital Marketing","description":"SEO, content, demand gen, and growth marketing"},"topic":{"slug":"answer-engine-optimization","label":"Answer Engine Optimization","description":"How B2B teams get content selected and cited by AI answer engines.","schemaKind":null},"answer":{"id":"de717b06-01be-4de5-9285-bec6bebad067","slug":"biggest-aeo-mistakes-to-avoid","question":"What are the biggest AEO mistakes to avoid?","answerMarkdown":"The most expensive AEO mistakes remove a site from the candidate pool before content quality matters: blocking the crawlers that feed AI answers, publishing pages that fall under Google's scaled content abuse policy [2], and leaving main content in client-side JavaScript that no major AI crawler executes [11]. Access rules are easy to get wrong because every platform separates its search crawler from its training crawler, so disallowing GPTBot only signals a training opt-out while disallowing OAI-SearchBot removes a site from ChatGPT search answers [7], and a CDN-level block on training crawlers can now catch Googlebot as well [9]. The second cluster of mistakes is measurement, since Search Console's generative AI report gives impressions with no clicks and no average position [5], and Google Analytics only recently began grouping AI assistant arrivals into their own channel while still excluding AI Overviews and AI Mode [6]. Judging the program by referral volume is the most common misread of all: AI-referred traffic sat at 0.2% of visits across 6,500 sites in Contentsquare's 2026 benchmark [14], while Ahrefs recorded 0.5% of its own traffic producing 12.1% of signups [13].","answerText":"The most expensive AEO mistakes remove a site from the candidate pool before content quality matters: blocking the crawlers that feed AI answers, publishing pages that fall under Google's scaled content abuse policy [2], and leaving main content in client-side JavaScript that no major AI crawler executes [11]. Access rules are easy to get wrong because every platform separates its search crawler from its training crawler, so disallowing GPTBot only signals a training opt-out while disallowing OAI-SearchBot removes a site from ChatGPT search answers [7], and a CDN-level block on training crawlers can now catch Googlebot as well [9]. The second cluster of mistakes is measurement, since Search Console's generative AI report gives impressions with no clicks and no average position [5], and Google Analytics only recently began grouping AI assistant arrivals into their own channel while still excluding AI Overviews and AI Mode [6]. Judging the program by referral volume is the most common misread of all: AI-referred traffic sat at 0.2% of visits across 6,500 sites in Contentsquare's 2026 benchmark [14], while Ahrefs recorded 0.5% of its own traffic producing 12.1% of signups [13].","answerHtml":"<p>The most expensive AEO mistakes remove a site from the candidate pool before content quality matters: blocking the crawlers that feed AI answers, publishing pages that fall under Google&#39;s scaled content abuse policy <a href=\"https://developers.google.com/search/docs/essentials/spam-policies\" class=\"citation-ref\" data-citation-index=\"2\" target=\"_blank\" rel=\"noreferrer\">[2]</a>, and leaving main content in client-side JavaScript that no major AI crawler executes <a href=\"https://vercel.com/blog/the-rise-of-the-ai-crawler\" class=\"citation-ref\" data-citation-index=\"11\" target=\"_blank\" rel=\"noreferrer\">[11]</a>. Access rules are easy to get wrong because every platform separates its search crawler from its training crawler, so disallowing GPTBot only signals a training opt-out while disallowing OAI-SearchBot removes a site from ChatGPT search answers <a href=\"https://developers.openai.com/api/docs/bots\" class=\"citation-ref\" data-citation-index=\"7\" target=\"_blank\" rel=\"noreferrer\">[7]</a>, and a CDN-level block on training crawlers can now catch Googlebot as well <a href=\"https://blog.cloudflare.com/content-independence-day-ai-options/\" class=\"citation-ref\" data-citation-index=\"9\" target=\"_blank\" rel=\"noreferrer\">[9]</a>. The second cluster of mistakes is measurement, since Search Console&#39;s generative AI report gives impressions with no clicks and no average position <a href=\"https://support.google.com/webmasters/answer/16984139?hl=en\" class=\"citation-ref\" data-citation-index=\"5\" target=\"_blank\" rel=\"noreferrer\">[5]</a>, and Google Analytics only recently began grouping AI assistant arrivals into their own channel while still excluding AI Overviews and AI Mode <a href=\"https://support.google.com/analytics/answer/9756891?hl=en\" class=\"citation-ref\" data-citation-index=\"6\" target=\"_blank\" rel=\"noreferrer\">[6]</a>. Judging the program by referral volume is the most common misread of all: AI-referred traffic sat at 0.2% of visits across 6,500 sites in Contentsquare&#39;s 2026 benchmark <a href=\"https://contentsquare.com/blog/ai-referred-traffic/\" class=\"citation-ref\" data-citation-index=\"14\" target=\"_blank\" rel=\"noreferrer\">[14]</a>, while Ahrefs recorded 0.5% of its own traffic producing 12.1% of signups <a href=\"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/\" class=\"citation-ref\" data-citation-index=\"13\" target=\"_blank\" rel=\"noreferrer\">[13]</a>.</p>\n","summary":"Seven high-cost AEO mistakes, each with the evidence for why it hurts and the specific correction: chasing referral volume instead of buyer fit, blocking AI crawlers by accident at the robots.txt or CDN layer, mass-producing thin optimized pages, ignoring the third-party sources AI answers actually cite, running AEO apart from crawlability and indexing, publishing with no measurement baseline, and treating a page that earned a citation as permanently cited.","publishedAt":"2026-08-28T14:15:04.474","verifiedAt":"2026-08-09T00:00:00","editorialStatus":"APPROVED","lastReviewedAt":"2026-08-09T00:00:00","nextReviewDueAt":"2026-11-09T00:00:00","templateVersion":"v2","aliases":["Biggest AEO mistakes","Common answer engine optimization mistakes","AEO mistakes to avoid","What not to do in AEO","Why is my AEO not working","Common GEO mistakes","Generative engine optimization mistakes","AI search optimization mistakes","AEO pitfalls","Why brands fail at answer engine optimization","Mistakes that hurt AI search visibility","AEO errors that waste budget"],"confidenceScore":87,"confidenceLabel":"High","canonicalUrl":null},"contributor":{"id":"ec39deab-44fe-48d8-9029-fefe993ab85a","slug":"answer-stack","displayName":"AnswerStack","websiteUrl":null},"contributorOrganizationProfile":{"entityId":"ec39deab-44fe-48d8-9029-fefe993ab85a","legalName":null,"description":null,"websiteUrl":null,"imageUrl":null,"slogan":null,"subtitle":null,"facts":[],"coiNote":null,"foundingDate":null,"numberOfEmployeesText":null,"contactPoint":null,"address":null,"headquartersText":null,"organizationType":null},"contributorPerson":{"slug":"answerstack-editorial-team","displayName":"AnswerStack Editorial Team"},"sections":[{"id":"3d1c7c3a-4b86-47ce-a1b7-6c9e5d0881f9","sectionKey":"why_aeo_programs_underperform","sectionType":"markdown_section","heading":"Why do AEO programs usually underperform?","introMarkdown":"AEO programs underperform for reasons that sit upstream of writing quality. Access, eligibility, and measurement failures decide whether a page can be cited at all, and none of them are visible in the content itself. Google states the eligibility rule plainly: to be shown as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet, meeting the Search technical requirements [1]. A page that fails that test cannot be rescued by better headings or more FAQ schema.\n\n### The access layer got more complicated\n\nEach platform now runs several crawlers with different jobs, and one robots.txt line covers all of them if the user agent is wrong. OpenAI separates OAI-SearchBot, which surfaces sites in ChatGPT's search features, from GPTBot, which collects training data [7]. Anthropic splits ClaudeBot for training from Claude-SearchBot for search indexing and Claude-User for live user-triggered fetches [8]. Google's Google-Extended token governs Gemini Apps training and grounding plus Vertex AI grounding, and does not affect Search inclusion or ranking at all [3].\n\n### Content and judgment failures follow\n\nGoogle's scaled content abuse policy targets pages generated in volume to manipulate rankings rather than help users, and it names generative AI tools as one route to that outcome [2]. Separately, AI referral traffic came to 0.2% of visits across 99 billion sessions in Contentsquare's 2026 benchmark [14], which makes raw volume a poor read on whether the work paid off. The mistakes below are ordered by cost relative to how often they go unnoticed.","introHtml":"<p>AEO programs underperform for reasons that sit upstream of writing quality. Access, eligibility, and measurement failures decide whether a page can be cited at all, and none of them are visible in the content itself. Google states the eligibility rule plainly: to be shown as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet, meeting the Search technical requirements <a href=\"https://developers.google.com/search/docs/appearance/ai-features\" class=\"citation-ref\" data-citation-index=\"1\" target=\"_blank\" rel=\"noreferrer\">[1]</a>. A page that fails that test cannot be rescued by better headings or more FAQ schema.</p>\n<h3>The access layer got more complicated</h3>\n<p>Each platform now runs several crawlers with different jobs, and one robots.txt line covers all of them if the user agent is wrong. OpenAI separates OAI-SearchBot, which surfaces sites in ChatGPT&#39;s search features, from GPTBot, which collects training data <a href=\"https://developers.openai.com/api/docs/bots\" class=\"citation-ref\" data-citation-index=\"7\" target=\"_blank\" rel=\"noreferrer\">[7]</a>. Anthropic splits ClaudeBot for training from Claude-SearchBot for search indexing and Claude-User for live user-triggered fetches <a href=\"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler\" class=\"citation-ref\" data-citation-index=\"8\" target=\"_blank\" rel=\"noreferrer\">[8]</a>. Google&#39;s Google-Extended token governs Gemini Apps training and grounding plus Vertex AI grounding, and does not affect Search inclusion or ranking at all <a href=\"https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers\" class=\"citation-ref\" data-citation-index=\"3\" target=\"_blank\" rel=\"noreferrer\">[3]</a>.</p>\n<h3>Content and judgment failures follow</h3>\n<p>Google&#39;s scaled content abuse policy targets pages generated in volume to manipulate rankings rather than help users, and it names generative AI tools as one route to that outcome <a href=\"https://developers.google.com/search/docs/essentials/spam-policies\" class=\"citation-ref\" data-citation-index=\"2\" target=\"_blank\" rel=\"noreferrer\">[2]</a>. Separately, AI referral traffic came to 0.2% of visits across 99 billion sessions in Contentsquare&#39;s 2026 benchmark <a href=\"https://contentsquare.com/blog/ai-referred-traffic/\" class=\"citation-ref\" data-citation-index=\"14\" target=\"_blank\" rel=\"noreferrer\">[14]</a>, which makes raw volume a poor read on whether the work paid off. The mistakes below are ordered by cost relative to how often they go unnoticed.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":0},{"id":"fb780471-8d69-497c-a1c0-326eb08ec62b","sectionKey":"mistakes_table","sectionType":"table_section","heading":"Which AEO mistakes cost the most?","introMarkdown":"Each row maps a mistake to its usual cause, the documented cost, and the correction. Every row is explained in full below.","introHtml":"<p>Each row maps a mistake to its usual cause, the documented cost, and the correction. Every row is explained in full below.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{"rows":[{"cells":["Chasing AI traffic volume over fit","Session-count KPIs get ported over from SEO reporting","Programs read as failures by month three; AI referrals were 0.2% of visits across 6,500 sites [14]","Measure appearance rate on a fixed prompt set and downstream conversion [13]"]},{"cells":["Blocking AI crawlers unintentionally","Search, agent, and training crawlers share one robots.txt and one CDN rule set","Removal from ChatGPT search answers [7] or Gemini grounding [3]; a Cloudflare Training block also catches Googlebot [9]","Write per-crawler rules by purpose, then audit CDN settings and server logs [9]"]},{"cells":["Thin \"AEO-optimized\" content at scale","Templated question pages are cheap to generate","Scaled content abuse is a spam policy violation however the text was produced [2]","Publish fewer pages, each carrying information not already on the web [2]"]},{"cells":["Ignoring off-site presence","AEO budget sits inside the website team","Reddit and Wikipedia top ChatGPT's most-cited domains [15]","Work the third-party surfaces already cited for your prompts [15]"]},{"cells":["Treating AEO as separate from SEO","AEO is bought as a standalone service line","Unindexed pages are ineligible for AI Overviews [1]; client-rendered content is invisible to AI crawlers [11]","Confirm indexing and server-side rendering before answer formatting [11]"]},{"cells":["No measurement setup","Default analytics did not report AI sources until recently","AI sessions land in direct traffic; Search Console gives impressions only [5][6]","Baseline Search Console, the GA4 AI Assistants channel, and a prompt set [5][6]"]},{"cells":["Set-and-forget content","A page that earned a citation looks finished","Repeat ChatGPT answers shared only 21.2% of cited domains [16]; top-10 overlap fell from 76% to 38% [12]","Re-check the same prompt set on a schedule; refresh dated specifics [16]"]}],"columns":["Mistake","Why it happens","What it costs","The correction"]},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":1},{"id":"69f419af-2bbd-4e02-b0ef-e6565374727c","sectionKey":"mistake_traffic_volume","sectionType":"markdown_section","heading":"Why is chasing AI traffic volume the wrong goal?","introMarkdown":"AI referral volume is too small to justify a program on its own and too noisy to judge one by. Across 99 billion sessions on 6,500 sites, Contentsquare's 2026 benchmark put AI-referred traffic at 0.2% of total visits, growing 632% year over year and converting at 1.3%, below email at 1.9% [14]. A program measured on session counts against that baseline reads as a failure by month three and gets defunded before it can compound.\n\nThe value shows up in composition rather than count. Ahrefs published its own numbers in June 2025: 0.5% of its traffic came from AI search, and that 0.5% produced 12.1% of signups, a conversion rate it calculated as 23 times higher than traditional organic for its business [13]. The two datasets do not contradict each other. Contentsquare reports a cross-industry average, while Ahrefs reports a product whose buyers ask AI assistants exactly the comparison questions its content answers.\n\nThe real cost of the volume mindset is misallocation. Teams optimizing for clicks gravitate toward queries that still produce clicks, which pushes effort into the informational middle of the funnel where AI answers now absorb the click anyway, and away from the decision-stage questions where a citation influences a purchase.\n\nThe correction is to define the outcome before the tactics. Choose the 30 to 100 prompts a buyer would plausibly type before selecting a vendor in your category, measure how often you appear in those answers, and track pipeline from AI-sourced sessions separately. Session volume becomes a diagnostic input rather than the scoreboard.","introHtml":"<p>AI referral volume is too small to justify a program on its own and too noisy to judge one by. Across 99 billion sessions on 6,500 sites, Contentsquare&#39;s 2026 benchmark put AI-referred traffic at 0.2% of total visits, growing 632% year over year and converting at 1.3%, below email at 1.9% <a href=\"https://contentsquare.com/blog/ai-referred-traffic/\" class=\"citation-ref\" data-citation-index=\"14\" target=\"_blank\" rel=\"noreferrer\">[14]</a>. A program measured on session counts against that baseline reads as a failure by month three and gets defunded before it can compound.</p>\n<p>The value shows up in composition rather than count. Ahrefs published its own numbers in June 2025: 0.5% of its traffic came from AI search, and that 0.5% produced 12.1% of signups, a conversion rate it calculated as 23 times higher than traditional organic for its business <a href=\"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/\" class=\"citation-ref\" data-citation-index=\"13\" target=\"_blank\" rel=\"noreferrer\">[13]</a>. The two datasets do not contradict each other. Contentsquare reports a cross-industry average, while Ahrefs reports a product whose buyers ask AI assistants exactly the comparison questions its content answers.</p>\n<p>The real cost of the volume mindset is misallocation. Teams optimizing for clicks gravitate toward queries that still produce clicks, which pushes effort into the informational middle of the funnel where AI answers now absorb the click anyway, and away from the decision-stage questions where a citation influences a purchase.</p>\n<p>The correction is to define the outcome before the tactics. Choose the 30 to 100 prompts a buyer would plausibly type before selecting a vendor in your category, measure how often you appear in those answers, and track pipeline from AI-sourced sessions separately. Session volume becomes a diagnostic input rather than the scoreboard.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":2},{"id":"5a37fbb6-dcc4-4cdf-b998-d3ada58f48db","sectionKey":"mistake_blocking_crawlers","sectionType":"markdown_section","heading":"How do sites block AI crawlers without meaning to?","introMarkdown":"Unintentional blocks happen because one rule covers crawlers that do completely different jobs. OpenAI documents the split directly: sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, while disallowing GPTBot indicates only that content should not be used to train foundation models [7]. Anthropic reports the same effect for its own bots, warning that disabling Claude-SearchBot may reduce a site's visibility and accuracy in user search results [8].\n\n### The CDN layer reaches further than most teams assume\n\nCloudflare's July 2026 update sorts AI traffic into Search, Agent, and Training categories and applies the most restrictive matching rule, so multi-purpose crawlers including Googlebot, Applebot, and BingBot are blocked for customers who selected a Training block [9]. From September 15, 2026, new domains get Training and Agent blocked by default on pages that display ads [9]. A setting someone enabled in 2024 to keep content out of model training can quietly cover the crawler feeding ordinary search results.\n\n### There is now a switch inside Search Console\n\nGoogle's search generative AI control lets an owner exclude a site from AI Overviews, AI Mode, and generative features in Discover, after which links to the site will not appear in those features [4]. It does not affect the rest of Search, so a site can vanish from AI answers while its organic reporting looks unchanged.\n\nThe correction is a quarterly access audit. Read robots.txt against each platform's published user agent list, check the bot rules in the CDN or WAF, since those usually belong to a different team than the one running content, and use server logs to confirm that search-purpose crawlers are receiving 200 responses instead of 403s.","introHtml":"<p>Unintentional blocks happen because one rule covers crawlers that do completely different jobs. OpenAI documents the split directly: sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, while disallowing GPTBot indicates only that content should not be used to train foundation models <a href=\"https://developers.openai.com/api/docs/bots\" class=\"citation-ref\" data-citation-index=\"7\" target=\"_blank\" rel=\"noreferrer\">[7]</a>. Anthropic reports the same effect for its own bots, warning that disabling Claude-SearchBot may reduce a site&#39;s visibility and accuracy in user search results <a href=\"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler\" class=\"citation-ref\" data-citation-index=\"8\" target=\"_blank\" rel=\"noreferrer\">[8]</a>.</p>\n<h3>The CDN layer reaches further than most teams assume</h3>\n<p>Cloudflare&#39;s July 2026 update sorts AI traffic into Search, Agent, and Training categories and applies the most restrictive matching rule, so multi-purpose crawlers including Googlebot, Applebot, and BingBot are blocked for customers who selected a Training block <a href=\"https://blog.cloudflare.com/content-independence-day-ai-options/\" class=\"citation-ref\" data-citation-index=\"9\" target=\"_blank\" rel=\"noreferrer\">[9]</a>. From September 15, 2026, new domains get Training and Agent blocked by default on pages that display ads <a href=\"https://blog.cloudflare.com/content-independence-day-ai-options/\" class=\"citation-ref\" data-citation-index=\"9\" target=\"_blank\" rel=\"noreferrer\">[9]</a>. A setting someone enabled in 2024 to keep content out of model training can quietly cover the crawler feeding ordinary search results.</p>\n<h3>There is now a switch inside Search Console</h3>\n<p>Google&#39;s search generative AI control lets an owner exclude a site from AI Overviews, AI Mode, and generative features in Discover, after which links to the site will not appear in those features <a href=\"https://support.google.com/webmasters/answer/16908024?hl=en\" class=\"citation-ref\" data-citation-index=\"4\" target=\"_blank\" rel=\"noreferrer\">[4]</a>. It does not affect the rest of Search, so a site can vanish from AI answers while its organic reporting looks unchanged.</p>\n<p>The correction is a quarterly access audit. Read robots.txt against each platform&#39;s published user agent list, check the bot rules in the CDN or WAF, since those usually belong to a different team than the one running content, and use server logs to confirm that search-purpose crawlers are receiving 200 responses instead of 403s.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":3},{"id":"655ba21b-e4ea-4485-9312-57292170c49c","sectionKey":"mistake_thin_content","sectionType":"markdown_section","heading":"What goes wrong with mass-produced \"AEO-optimized\" pages?","introMarkdown":"Publishing hundreds of near-identical question pages puts a site inside Google's definition of scaled content abuse, which covers generating many pages for the primary purpose of manipulating search rankings and not helping users [2]. The policy lists using generative AI tools to produce many pages without adding value as an example, and applies the same standard however the text was created [2].\n\nAuthorship is the part teams get backwards. The exposure is not that a system detects machine writing and rejects it. Google's policy turns on whether pages add value, so a well-edited AI-assisted page carrying original information sits outside it while a hand-written page restating public knowledge at scale sits inside it.\n\n### Redundancy is expensive in a specific way\n\nAn answer engine retrieves a small set of passages per query, so a page competes on whether it holds a fact, number, or first-hand observation the alternatives lack. Three hundred templated pages restating what is already documented elsewhere give a retrieval system three hundred equally skippable candidates. Volume does not raise the odds of selection when every candidate carries the same information.\n\nThe cost compounds at the site level. Vercel's crawl data shows AI crawlers already wasting roughly a third of their fetches on pages that return 404 [11], and adding thin pages spends more of that budget on content nobody will retrieve.\n\nThe correction is to trade volume for information gain. Publish when a page carries something original: your own data, a documented process with real numbers, pricing you will stand behind, or a limitation nobody else writes down. Fewer pages that each answer one question completely outperform a library answering forty questions partially.","introHtml":"<p>Publishing hundreds of near-identical question pages puts a site inside Google&#39;s definition of scaled content abuse, which covers generating many pages for the primary purpose of manipulating search rankings and not helping users <a href=\"https://developers.google.com/search/docs/essentials/spam-policies\" class=\"citation-ref\" data-citation-index=\"2\" target=\"_blank\" rel=\"noreferrer\">[2]</a>. The policy lists using generative AI tools to produce many pages without adding value as an example, and applies the same standard however the text was created <a href=\"https://developers.google.com/search/docs/essentials/spam-policies\" class=\"citation-ref\" data-citation-index=\"2\" target=\"_blank\" rel=\"noreferrer\">[2]</a>.</p>\n<p>Authorship is the part teams get backwards. The exposure is not that a system detects machine writing and rejects it. Google&#39;s policy turns on whether pages add value, so a well-edited AI-assisted page carrying original information sits outside it while a hand-written page restating public knowledge at scale sits inside it.</p>\n<h3>Redundancy is expensive in a specific way</h3>\n<p>An answer engine retrieves a small set of passages per query, so a page competes on whether it holds a fact, number, or first-hand observation the alternatives lack. Three hundred templated pages restating what is already documented elsewhere give a retrieval system three hundred equally skippable candidates. Volume does not raise the odds of selection when every candidate carries the same information.</p>\n<p>The cost compounds at the site level. Vercel&#39;s crawl data shows AI crawlers already wasting roughly a third of their fetches on pages that return 404 <a href=\"https://vercel.com/blog/the-rise-of-the-ai-crawler\" class=\"citation-ref\" data-citation-index=\"11\" target=\"_blank\" rel=\"noreferrer\">[11]</a>, and adding thin pages spends more of that budget on content nobody will retrieve.</p>\n<p>The correction is to trade volume for information gain. Publish when a page carries something original: your own data, a documented process with real numbers, pricing you will stand behind, or a limitation nobody else writes down. Fewer pages that each answer one question completely outperform a library answering forty questions partially.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":4},{"id":"33474f9d-2bb7-4365-adeb-7799e0eb9015","sectionKey":"mistake_offsite","sectionType":"markdown_section","heading":"Why does ignoring off-site presence cap AI visibility?","introMarkdown":"AI answers draw heavily on sources you do not own, so a website-only program competes for a minority of the citation slots. Semrush analyzed more than 100 million AI citations from 230,000 prompts across ChatGPT search, Google AI Mode, and Perplexity in weekly snapshots between July 14 and October 12, 2025, and found Reddit and Wikipedia holding the top two positions among ChatGPT's most-cited domains [15]. Community platforms and reference sites sit ahead of nearly every brand-owned domain in that ranking.\n\nThe practical consequence is that a category's buying questions often get answered from a forum thread, a review platform, an encyclopedia entry, or a roundup on a publisher site. If a product is absent from those places, or described with outdated pricing and features, the model's answer inherits the gap regardless of how well the company's own pages are structured.\n\nThat pool also moves on its own. Semrush recorded a mid-September 2025 change that dropped Reddit from roughly 60% of ChatGPT responses to around 10%, while Google AI Mode and Perplexity stayed consistent [15].\n\nThe correction is to treat off-site work as part of the same program rather than public relations overflow. Identify which third-party URLs are actually cited for your priority prompts, then work those surfaces. Outdated facts on review and comparison sites are usually the fastest fix, since one correction can change how several answers describe you. Participating honestly in the communities where your category gets discussed is slower and much harder to fake, which is part of why it holds up. A model reconciling conflicting descriptions across sources tends to reach for the version that appears most often.","introHtml":"<p>AI answers draw heavily on sources you do not own, so a website-only program competes for a minority of the citation slots. Semrush analyzed more than 100 million AI citations from 230,000 prompts across ChatGPT search, Google AI Mode, and Perplexity in weekly snapshots between July 14 and October 12, 2025, and found Reddit and Wikipedia holding the top two positions among ChatGPT&#39;s most-cited domains <a href=\"https://www.semrush.com/blog/most-cited-domains-ai/\" class=\"citation-ref\" data-citation-index=\"15\" target=\"_blank\" rel=\"noreferrer\">[15]</a>. Community platforms and reference sites sit ahead of nearly every brand-owned domain in that ranking.</p>\n<p>The practical consequence is that a category&#39;s buying questions often get answered from a forum thread, a review platform, an encyclopedia entry, or a roundup on a publisher site. If a product is absent from those places, or described with outdated pricing and features, the model&#39;s answer inherits the gap regardless of how well the company&#39;s own pages are structured.</p>\n<p>That pool also moves on its own. Semrush recorded a mid-September 2025 change that dropped Reddit from roughly 60% of ChatGPT responses to around 10%, while Google AI Mode and Perplexity stayed consistent <a href=\"https://www.semrush.com/blog/most-cited-domains-ai/\" class=\"citation-ref\" data-citation-index=\"15\" target=\"_blank\" rel=\"noreferrer\">[15]</a>.</p>\n<p>The correction is to treat off-site work as part of the same program rather than public relations overflow. Identify which third-party URLs are actually cited for your priority prompts, then work those surfaces. Outdated facts on review and comparison sites are usually the fastest fix, since one correction can change how several answers describe you. Participating honestly in the communities where your category gets discussed is slower and much harder to fake, which is part of why it holds up. A model reconciling conflicting descriptions across sources tends to reach for the version that appears most often.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":5},{"id":"e1569e3e-0f72-4a2b-aa48-6070c5ff80f7","sectionKey":"mistake_aeo_vs_seo","sectionType":"markdown_section","heading":"What breaks when AEO is run separately from SEO?","introMarkdown":"Eligibility breaks. Google's documentation states that a page must be indexed and eligible to be shown in Google Search with a snippet, fulfilling the Search technical requirements, before it can appear as a supporting link in AI Overviews or AI Mode [1]. An engagement that delivers schema, answer-first formatting, and an llms.txt file while leaving a page uncrawlable has optimized something that cannot be selected.\n\n### Rendering is the failure that hides best\n\nVercel and MERJ analyzed 569 million GPTBot fetches and 370 million Claude fetches and found no evidence that any major AI crawler executes JavaScript, even though ChatGPT fetched JavaScript files on 11.50% of requests and Claude on 23.84% [11]. Content that exists only after client-side hydration is absent from what those crawlers read. The same analysis found ChatGPT spending 34.82% of its fetches on 404 pages against Googlebot's 8.22%, so stale links and unmanaged redirects waste far more of an AI crawler's budget [11].\n\n### Weakening rank correlation argues for fundamentals, not against them\n\nAhrefs' March 2026 analysis of 863,000 keyword SERPs and 4 million AI Overview URLs found 38% of cited pages also ranked in the top 10, down from roughly 76% in July 2025, with the rest split almost evenly between positions 11 to 100 at 31.2% and beyond the top 100 at 31.0% [12]. Being indexed and reasonably visible still puts a page in the pool, and a top-three position no longer guarantees the citation.\n\nThe correction is sequencing. Confirm that main content renders server-side and that pages are indexed with clean status codes before spending on answer formatting. The technical work is cheaper, it is verifiable, and it gates everything downstream.","introHtml":"<p>Eligibility breaks. Google&#39;s documentation states that a page must be indexed and eligible to be shown in Google Search with a snippet, fulfilling the Search technical requirements, before it can appear as a supporting link in AI Overviews or AI Mode <a href=\"https://developers.google.com/search/docs/appearance/ai-features\" class=\"citation-ref\" data-citation-index=\"1\" target=\"_blank\" rel=\"noreferrer\">[1]</a>. An engagement that delivers schema, answer-first formatting, and an llms.txt file while leaving a page uncrawlable has optimized something that cannot be selected.</p>\n<h3>Rendering is the failure that hides best</h3>\n<p>Vercel and MERJ analyzed 569 million GPTBot fetches and 370 million Claude fetches and found no evidence that any major AI crawler executes JavaScript, even though ChatGPT fetched JavaScript files on 11.50% of requests and Claude on 23.84% <a href=\"https://vercel.com/blog/the-rise-of-the-ai-crawler\" class=\"citation-ref\" data-citation-index=\"11\" target=\"_blank\" rel=\"noreferrer\">[11]</a>. Content that exists only after client-side hydration is absent from what those crawlers read. The same analysis found ChatGPT spending 34.82% of its fetches on 404 pages against Googlebot&#39;s 8.22%, so stale links and unmanaged redirects waste far more of an AI crawler&#39;s budget <a href=\"https://vercel.com/blog/the-rise-of-the-ai-crawler\" class=\"citation-ref\" data-citation-index=\"11\" target=\"_blank\" rel=\"noreferrer\">[11]</a>.</p>\n<h3>Weakening rank correlation argues for fundamentals, not against them</h3>\n<p>Ahrefs&#39; March 2026 analysis of 863,000 keyword SERPs and 4 million AI Overview URLs found 38% of cited pages also ranked in the top 10, down from roughly 76% in July 2025, with the rest split almost evenly between positions 11 to 100 at 31.2% and beyond the top 100 at 31.0% <a href=\"https://ahrefs.com/blog/ai-overview-citations-top-10/\" class=\"citation-ref\" data-citation-index=\"12\" target=\"_blank\" rel=\"noreferrer\">[12]</a>. Being indexed and reasonably visible still puts a page in the pool, and a top-three position no longer guarantees the citation.</p>\n<p>The correction is sequencing. Confirm that main content renders server-side and that pages are indexed with clean status codes before spending on answer formatting. The technical work is cheaper, it is verifiable, and it gates everything downstream.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":6},{"id":"8c7e4204-fc99-4ecc-8b7c-c9aa9d2e6a93","sectionKey":"mistake_no_measurement","sectionType":"markdown_section","heading":"What happens without a measurement setup?","introMarkdown":"Without a baseline there is no way to tell whether AI visibility changed or whether the reporting did. Search Console's generative AI performance report covers impressions from AI Overviews and AI Mode, but does not include click data or average position, and it excludes experiments in Search Labs [5]. Impressions confirm that a link appeared and say nothing about whether anyone acted on it.\n\n### Analytics has a matching gap\n\nGoogle Analytics 4 now includes an AI Assistants default channel covering arrivals from sources such as ChatGPT, Gemini, DeepSeek, Copilot, and Grok, matched on an ai-assistant medium or a recognized AI referrer [6]. That channel explicitly excludes Google's AI Overviews and AI Mode, which arrive as ordinary organic search [6]. Sites that never configured custom channel groupings spent the preceding period filing a growing share of high-intent sessions under direct traffic, which is why so many programs cannot produce a credible before-and-after.\n\n### The baseline has to exist before the first change\n\nRecord where you stand on a fixed prompt set, capture current generative AI impressions in Search Console, and make sure AI-sourced sessions are separated in analytics with conversions attached. Re-run the identical prompt set on a schedule, since changing the wording alone moves results enough to invalidate the comparison.\n\nAhrefs' reporting shows why tying sessions to outcomes matters more than counting them: its AI search traffic was 0.5% of sessions and 12.1% of signups, a ratio visible only once AI sessions are separated from direct traffic and joined to conversion data [13].","introHtml":"<p>Without a baseline there is no way to tell whether AI visibility changed or whether the reporting did. Search Console&#39;s generative AI performance report covers impressions from AI Overviews and AI Mode, but does not include click data or average position, and it excludes experiments in Search Labs <a href=\"https://support.google.com/webmasters/answer/16984139?hl=en\" class=\"citation-ref\" data-citation-index=\"5\" target=\"_blank\" rel=\"noreferrer\">[5]</a>. Impressions confirm that a link appeared and say nothing about whether anyone acted on it.</p>\n<h3>Analytics has a matching gap</h3>\n<p>Google Analytics 4 now includes an AI Assistants default channel covering arrivals from sources such as ChatGPT, Gemini, DeepSeek, Copilot, and Grok, matched on an ai-assistant medium or a recognized AI referrer <a href=\"https://support.google.com/analytics/answer/9756891?hl=en\" class=\"citation-ref\" data-citation-index=\"6\" target=\"_blank\" rel=\"noreferrer\">[6]</a>. That channel explicitly excludes Google&#39;s AI Overviews and AI Mode, which arrive as ordinary organic search <a href=\"https://support.google.com/analytics/answer/9756891?hl=en\" class=\"citation-ref\" data-citation-index=\"6\" target=\"_blank\" rel=\"noreferrer\">[6]</a>. Sites that never configured custom channel groupings spent the preceding period filing a growing share of high-intent sessions under direct traffic, which is why so many programs cannot produce a credible before-and-after.</p>\n<h3>The baseline has to exist before the first change</h3>\n<p>Record where you stand on a fixed prompt set, capture current generative AI impressions in Search Console, and make sure AI-sourced sessions are separated in analytics with conversions attached. Re-run the identical prompt set on a schedule, since changing the wording alone moves results enough to invalidate the comparison.</p>\n<p>Ahrefs&#39; reporting shows why tying sessions to outcomes matters more than counting them: its AI search traffic was 0.5% of sessions and 12.1% of signups, a ratio visible only once AI sessions are separated from direct traffic and joined to conversion data <a href=\"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/\" class=\"citation-ref\" data-citation-index=\"13\" target=\"_blank\" rel=\"noreferrer\">[13]</a>.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":7},{"id":"c2f1eb72-4c9a-4eec-95fa-098df2c6dd30","sectionKey":"mistake_set_and_forget","sectionType":"markdown_section","heading":"Why does set-and-forget AEO content stop working?","introMarkdown":"Citations are not durable, which makes a page that earned one in March an unreliable asset by June. Parse measured 693,509 answers across 16,143 ChatGPT prompts and 15,805 Google AI Overviews prompts between March 26 and April 25, 2026, and found two repeat ChatGPT answers to the same prompt shared only 21.2% of cited domains on average, with AI Overviews steadier at 31.5% [16]. Source churn exceeded 75% in every industry the study examined [16].\n\n### Selection rules move independently of your content\n\nAhrefs' comparison of its July 2025 and March 2026 datasets shows Google pulling far fewer AI Overview citations straight from the original SERP, with top-10 overlap falling from about 76% to 38% [12]. Semrush caught a single mid-September 2025 change that dropped Reddit from roughly 60% of ChatGPT responses to around 10% [15]. Neither shift had anything to do with the content on the affected pages.\n\nTwo things follow. Measuring visibility once produces a number with a wide error bar, so a single check showing a brand cited or absent should not drive a decision. And a page that stops being cited has usually not degraded; either the surrounding pool changed or a competitor published something more specific.\n\nThe correction is a maintenance cadence rather than a campaign. Re-check the prompt set at a consistent interval, read appearance rate as a trend line rather than a status, and refresh pages carrying dated facts, pricing, or product details before those numbers go stale. Pages built on original data need a review date attached at publication.","introHtml":"<p>Citations are not durable, which makes a page that earned one in March an unreliable asset by June. Parse measured 693,509 answers across 16,143 ChatGPT prompts and 15,805 Google AI Overviews prompts between March 26 and April 25, 2026, and found two repeat ChatGPT answers to the same prompt shared only 21.2% of cited domains on average, with AI Overviews steadier at 31.5% <a href=\"https://parse.gl/research/ai-citation-volatility-by-industry\" class=\"citation-ref\" data-citation-index=\"16\" target=\"_blank\" rel=\"noreferrer\">[16]</a>. Source churn exceeded 75% in every industry the study examined <a href=\"https://parse.gl/research/ai-citation-volatility-by-industry\" class=\"citation-ref\" data-citation-index=\"16\" target=\"_blank\" rel=\"noreferrer\">[16]</a>.</p>\n<h3>Selection rules move independently of your content</h3>\n<p>Ahrefs&#39; comparison of its July 2025 and March 2026 datasets shows Google pulling far fewer AI Overview citations straight from the original SERP, with top-10 overlap falling from about 76% to 38% <a href=\"https://ahrefs.com/blog/ai-overview-citations-top-10/\" class=\"citation-ref\" data-citation-index=\"12\" target=\"_blank\" rel=\"noreferrer\">[12]</a>. Semrush caught a single mid-September 2025 change that dropped Reddit from roughly 60% of ChatGPT responses to around 10% <a href=\"https://www.semrush.com/blog/most-cited-domains-ai/\" class=\"citation-ref\" data-citation-index=\"15\" target=\"_blank\" rel=\"noreferrer\">[15]</a>. Neither shift had anything to do with the content on the affected pages.</p>\n<p>Two things follow. Measuring visibility once produces a number with a wide error bar, so a single check showing a brand cited or absent should not drive a decision. And a page that stops being cited has usually not degraded; either the surrounding pool changed or a competitor published something more specific.</p>\n<p>The correction is a maintenance cadence rather than a campaign. Re-check the prompt set at a consistent interval, read appearance rate as a trend line rather than a status, and refresh pages carrying dated facts, pricing, or product details before those numbers go stale. Pages built on original data need a review date attached at publication.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":8},{"id":"c492b745-2055-4eef-b9ed-21eb0fc0bec3","sectionKey":"trade_offs","sectionType":"markdown_section","heading":"Trade-offs and what to watch","introMarkdown":"### The evidence base is uneven by design\n\nPlatform documentation is reliable on access and eligibility and nearly silent on selection. Google publishes the bar for appearing in AI Overviews and AI Mode [1] without publishing how a page gets chosen from the eligible pool. Everything about selection comes from third-party measurement of observed outputs, which shifts whenever the platforms change.\n\n### Published conversion multiples do not transfer\n\nThe 23x figure comes from Ahrefs' own traffic, for a product whose buyers ask AI assistants comparison questions [13]. Contentsquare's cross-industry benchmark shows AI-referred traffic converting at 1.3%, below email [14]. Using any published multiple as a forecast produces a business case that will not survive contact with your own numbers.\n\n### Blocking crawlers is sometimes defensible\n\nNot every block is a mistake to reverse. Cloudflare reported OpenAI crawling at roughly 1,700 fetches per referral and Anthropic at about 73,000 to 1 in June 2025, against roughly 14 Google crawls per referral [10]. A publisher whose revenue depends on page views may reasonably conclude the exchange is poor. The mistake is making that call by accident, or applying it to search crawlers when the intent was to limit training.\n\n### Vendor measurement is not standardized\n\nAEO tools sample different prompt sets, at different frequencies, from different locations, and report incompatible numbers for the same brand. Given the churn Parse measured [16], low sampling frequency can manufacture trends that are not there. Keeping one tool and one prompt set long enough to build a comparable series matters more than picking the best-scoring tool.","introHtml":"<h3>The evidence base is uneven by design</h3>\n<p>Platform documentation is reliable on access and eligibility and nearly silent on selection. Google publishes the bar for appearing in AI Overviews and AI Mode <a href=\"https://developers.google.com/search/docs/appearance/ai-features\" class=\"citation-ref\" data-citation-index=\"1\" target=\"_blank\" rel=\"noreferrer\">[1]</a> without publishing how a page gets chosen from the eligible pool. Everything about selection comes from third-party measurement of observed outputs, which shifts whenever the platforms change.</p>\n<h3>Published conversion multiples do not transfer</h3>\n<p>The 23x figure comes from Ahrefs&#39; own traffic, for a product whose buyers ask AI assistants comparison questions <a href=\"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/\" class=\"citation-ref\" data-citation-index=\"13\" target=\"_blank\" rel=\"noreferrer\">[13]</a>. Contentsquare&#39;s cross-industry benchmark shows AI-referred traffic converting at 1.3%, below email <a href=\"https://contentsquare.com/blog/ai-referred-traffic/\" class=\"citation-ref\" data-citation-index=\"14\" target=\"_blank\" rel=\"noreferrer\">[14]</a>. Using any published multiple as a forecast produces a business case that will not survive contact with your own numbers.</p>\n<h3>Blocking crawlers is sometimes defensible</h3>\n<p>Not every block is a mistake to reverse. Cloudflare reported OpenAI crawling at roughly 1,700 fetches per referral and Anthropic at about 73,000 to 1 in June 2025, against roughly 14 Google crawls per referral <a href=\"https://blog.cloudflare.com/control-content-use-for-ai-training/\" class=\"citation-ref\" data-citation-index=\"10\" target=\"_blank\" rel=\"noreferrer\">[10]</a>. A publisher whose revenue depends on page views may reasonably conclude the exchange is poor. The mistake is making that call by accident, or applying it to search crawlers when the intent was to limit training.</p>\n<h3>Vendor measurement is not standardized</h3>\n<p>AEO tools sample different prompt sets, at different frequencies, from different locations, and report incompatible numbers for the same brand. Given the churn Parse measured <a href=\"https://parse.gl/research/ai-citation-volatility-by-industry\" class=\"citation-ref\" data-citation-index=\"16\" target=\"_blank\" rel=\"noreferrer\">[16]</a>, low sampling frequency can manufacture trends that are not there. Keeping one tool and one prompt set long enough to build a comparable series matters more than picking the best-scoring tool.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":9},{"id":"d0ebdd6a-ec50-447b-9cce-dd6498217375","sectionKey":"what_these_are_not","sectionType":"markdown_section","heading":"What these mistakes are not","introMarkdown":"### Using AI to help write is not one of them\n\nGoogle's spam policies target scaled, low-value page generation and apply the same standard however the content was produced [2]. A page carrying original information and edited by someone who knows the subject is outside that policy regardless of what drafted the first version.\n\n### A month-over-month drop in AI sessions is not automatically a failure\n\nRepeat answers to the same prompt shared only 21.2% of cited domains in Parse's measurement [16], so short-term movement in AI referrals is often noise. Judge the program against a fixed prompt set across a quarter instead.\n\n### Declining model training is not the same as blocking search\n\nThe user agents are documented separately by OpenAI [7], Anthropic [8], and Google [3]. A site can opt out of training data collection and remain fully available to the crawlers that feed AI answers, provided the rules name the right bots.\n\n### Schema markup is not the missing piece by itself\n\nStructured data helps machines parse a page and does not create eligibility. A page still has to be indexed and snippet-eligible to appear as a supporting link in AI Overviews or AI Mode [1].\n\n### Zero citations is not always a content problem\n\nCheck access and rendering before rewriting anything. No major AI crawler executed JavaScript in Vercel and MERJ's analysis of nearly a billion fetches [11], so a client-rendered page can be genuinely good and still invisible.","introHtml":"<h3>Using AI to help write is not one of them</h3>\n<p>Google&#39;s spam policies target scaled, low-value page generation and apply the same standard however the content was produced <a href=\"https://developers.google.com/search/docs/essentials/spam-policies\" class=\"citation-ref\" data-citation-index=\"2\" target=\"_blank\" rel=\"noreferrer\">[2]</a>. A page carrying original information and edited by someone who knows the subject is outside that policy regardless of what drafted the first version.</p>\n<h3>A month-over-month drop in AI sessions is not automatically a failure</h3>\n<p>Repeat answers to the same prompt shared only 21.2% of cited domains in Parse&#39;s measurement <a href=\"https://parse.gl/research/ai-citation-volatility-by-industry\" class=\"citation-ref\" data-citation-index=\"16\" target=\"_blank\" rel=\"noreferrer\">[16]</a>, so short-term movement in AI referrals is often noise. Judge the program against a fixed prompt set across a quarter instead.</p>\n<h3>Declining model training is not the same as blocking search</h3>\n<p>The user agents are documented separately by OpenAI <a href=\"https://developers.openai.com/api/docs/bots\" class=\"citation-ref\" data-citation-index=\"7\" target=\"_blank\" rel=\"noreferrer\">[7]</a>, Anthropic <a href=\"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler\" class=\"citation-ref\" data-citation-index=\"8\" target=\"_blank\" rel=\"noreferrer\">[8]</a>, and Google <a href=\"https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers\" class=\"citation-ref\" data-citation-index=\"3\" target=\"_blank\" rel=\"noreferrer\">[3]</a>. A site can opt out of training data collection and remain fully available to the crawlers that feed AI answers, provided the rules name the right bots.</p>\n<h3>Schema markup is not the missing piece by itself</h3>\n<p>Structured data helps machines parse a page and does not create eligibility. A page still has to be indexed and snippet-eligible to appear as a supporting link in AI Overviews or AI Mode <a href=\"https://developers.google.com/search/docs/appearance/ai-features\" class=\"citation-ref\" data-citation-index=\"1\" target=\"_blank\" rel=\"noreferrer\">[1]</a>.</p>\n<h3>Zero citations is not always a content problem</h3>\n<p>Check access and rendering before rewriting anything. No major AI crawler executed JavaScript in Vercel and MERJ&#39;s analysis of nearly a billion fetches <a href=\"https://vercel.com/blog/the-rise-of-the-ai-crawler\" class=\"citation-ref\" data-citation-index=\"11\" target=\"_blank\" rel=\"noreferrer\">[11]</a>, so a client-rendered page can be genuinely good and still invisible.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":null,"noteHtml":null,"sortOrder":10},{"id":"024b57c6-82eb-447c-b294-19a7b3a252b7","sectionKey":"contributor_perspective","sectionType":"markdown_section","heading":"How this answer was researched","introMarkdown":"Every source cited here was opened and read on August 9, 2026, and each claim was written from what those pages say rather than from secondhand summaries. Platform documentation takes precedence, so crawler behavior, eligibility rules, and reporting limits come from Google, OpenAI, Anthropic, and Cloudflare's own docs. Where no documentation exists, which covers most of what people call AEO selection, the answer relies on third-party measurement of observed outputs and names the dataset and date at the point of the claim.\n\nNothing here recommends a vendor, an agency, or a tool. The AnswerStack Editorial Team holds no commercial relationship with any company named above and no stake in whether a reader buys AEO services.\n\nPractitioners with contradicting evidence are invited to submit it. Server logs showing different crawler behavior, prompt-set measurements across a defined period, or documented cases where one of these corrections did not hold are all useful, and this record will be updated with attribution when the evidence checks out.","introHtml":"<p>Every source cited here was opened and read on August 9, 2026, and each claim was written from what those pages say rather than from secondhand summaries. Platform documentation takes precedence, so crawler behavior, eligibility rules, and reporting limits come from Google, OpenAI, Anthropic, and Cloudflare&#39;s own docs. Where no documentation exists, which covers most of what people call AEO selection, the answer relies on third-party measurement of observed outputs and names the dataset and date at the point of the claim.</p>\n<p>Nothing here recommends a vendor, an agency, or a tool. The AnswerStack Editorial Team holds no commercial relationship with any company named above and no stake in whether a reader buys AEO services.</p>\n<p>Practitioners with contradicting evidence are invited to submit it. Server logs showing different crawler behavior, prompt-set measurements across a defined period, or documented cases where one of these corrections did not hold are all useful, and this record will be updated with attribution when the evidence checks out.</p>\n","outroMarkdown":null,"outroHtml":null,"contentJson":{},"configJson":{},"noteMarkdown":"This answer was written and reviewed by the AnswerStack Editorial Team, which has no commercial stake in the products, companies, or methods discussed. Every claim is cited inline and verified on the dates shown.","noteHtml":"<p>This answer was written and reviewed by the AnswerStack Editorial Team, which has no commercial stake in the products, companies, or methods discussed. Every claim is cited inline and verified on the dates shown.</p>\n","sortOrder":11}],"citations":[{"title":"AI features and your website","url":"https://developers.google.com/search/docs/appearance/ai-features","excerpt":"To be eligible to be shown as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet, fulfilling the Search technical requirements.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"Eligibility rule for AI Overviews and AI Mode; snippet controls limit what appears; no special optimization beyond standard Search requirements.","domain":"developers.google.com","publisherName":"Google Search Central"},{"title":"Spam Policies for Google Web Search","url":"https://developers.google.com/search/docs/essentials/spam-policies","excerpt":"Scaled content abuse is when many pages are generated for the primary purpose of manipulating search rankings and not helping users.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"Definition of scaled content abuse; generative AI tools named as an example; the standard applies regardless of how content was produced.","domain":"developers.google.com","publisherName":"Google Search Central"},{"title":"Google Common Crawlers (including Google-Extended)","url":"https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers","excerpt":"Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"Google-Extended controls Gemini Apps training and grounding plus Vertex AI grounding, and does not affect Google Search inclusion or ranking.","domain":"developers.google.com","publisherName":"Google Search Central"},{"title":"Search generative AI control","url":"https://support.google.com/webmasters/answer/16908024?hl=en","excerpt":"This control only affects whether your content can appear in certain Search generative AI features; this control isn't used as a ranking or inclusion signal affecting other parts of Search.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"A Search Console setting can exclude a site from AI Overviews, AI Mode, and generative features in Discover without affecting the rest of Search.","domain":"support.google.com","publisherName":"Google Search Console Help"},{"title":"Generative AI performance report (Search)","url":"https://support.google.com/webmasters/answer/16984139?hl=en","excerpt":"The report shows how many times links to your site appeared in AI Overviews and AI Mode. Clicks and average position are not available in this report.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"The generative AI report covers impressions from AI Overviews and AI Mode, without click data or average position, and excludes Search Labs experiments.","domain":"support.google.com","publisherName":"Google Search Console Help"},{"title":"Default channel group","url":"https://support.google.com/analytics/answer/9756891?hl=en","excerpt":"AI Assistants is the channel by which users arrive at your site from sources like ChatGPT, Gemini, Deepseek, Copilot, or Grok.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"GA4's AI Assistants channel, the platforms it recognizes, and its exclusion of Google AI Overviews and AI Mode.","domain":"support.google.com","publisherName":"Google Analytics Help"},{"title":"OpenAI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User)","url":"https://developers.openai.com/api/docs/bots","excerpt":"Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers. Disallowing GPTBot indicates a site's content should not be used in training generative AI foundation models.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"OAI-SearchBot controls appearance in ChatGPT search answers; GPTBot controls training data collection; ChatGPT-User handles user-triggered fetches.","domain":"developers.openai.com","publisherName":"OpenAI"},{"title":"Does Anthropic crawl data from the web, and how can site owners block the crawler?","url":"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","excerpt":"Disabling Claude-SearchBot on your site prevents our system from indexing your content for search optimization, which may reduce your site's visibility and accuracy in user search results.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"ClaudeBot handles training, Claude-SearchBot handles search indexing, and Claude-User handles live user-directed fetches; blocking each has a different effect.","domain":"support.claude.com","publisherName":"Anthropic"},{"title":"Your site, your rules: new AI traffic options for all customers","url":"https://blog.cloudflare.com/content-independence-day-ai-options/","excerpt":"Multi-purpose crawlers such as Googlebot, Applebot, and BingBot will be blocked by customers who have selected to block Training.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"Search, Agent, and Training categories; the September 15, 2026 default change for new domains; multi-purpose crawlers such as Googlebot blocked when Training is blocked. Published July 1, 2026.","domain":"blog.cloudflare.com","publisherName":"Cloudflare"},{"title":"Control content use for AI training with Cloudflare's managed robots.txt and blocking for monetized content","url":"https://blog.cloudflare.com/control-content-use-for-ai-training/","excerpt":"In June 2025, OpenAI's crawl-to-referral ratio was 1,700:1, Anthropic's 73,000:1.","quoteText":null,"sourceRole":"PRIMARY","verifiedAt":"2026-08-09T00:00:00","supportsText":"Crawl-to-referral ratios for OpenAI, Anthropic, and Google as of June 2025, used in the trade-offs section. Published July 1, 2025.","domain":"blog.cloudflare.com","publisherName":"Cloudflare"},{"title":"The rise of the AI crawler","url":"https://vercel.com/blog/the-rise-of-the-ai-crawler","excerpt":"They don't execute them. They can't read client-side rendered content. ChatGPT spends 34.82% of its fetches on 404 pages.","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"No major AI crawler executes JavaScript; fetch volumes; JS file fetch rates; 404 waste rates versus Googlebot.","domain":"vercel.com","publisherName":"Vercel (with MERJ)"},{"title":"Ahrefs study: AI Overview citations vs. top-10 rankings (863,000 keywords, 4 million cited URLs)","url":"https://ahrefs.com/blog/ai-overview-citations-top-10/","excerpt":"Google is selecting far fewer pages straight from the original SERP (~76% in July 2025 vs. ~38% today).","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"863K keyword SERPs and 4M AI Overview URLs as of March 2026; 38% top-10 overlap versus roughly 76% in July 2025; distribution across positions 11 to 100 and beyond 100.","domain":"ahrefs.com","publisherName":"Ahrefs"},{"title":"Does AI Search Traffic Convert Better Than Traditional Search? For Ahrefs, Yes: 0.5% of Visitors Drove 12.1% of Signups","url":"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/","excerpt":"12.1% of signups from 0.5% of the traffic. This channel performs really well for us.","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"0.5% of Ahrefs traffic from AI search producing 12.1% of signups, a 23x conversion rate versus traditional organic for that business. Published June 16, 2025.","domain":"ahrefs.com","publisherName":"Ahrefs"},{"title":"What Is AI-Referred Traffic? 2026 Benchmarks","url":"https://contentsquare.com/blog/ai-referred-traffic/","excerpt":"AI-referred traffic still represents just 0.2% of total visits. AI-referred traffic converted at 1.3% in 2025, a 55% increase year over year.","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"AI-referred traffic at 0.2% of total visits, 632% year-over-year growth, and a 1.3% conversion rate versus 1.9% for email, from 99 billion sessions across 6,500 sites.","domain":"contentsquare.com","publisherName":"Contentsquare"},{"title":"The Most-Cited Domains in AI: A 3-Month Study","url":"https://www.semrush.com/blog/most-cited-domains-ai/","excerpt":"We analyzed 230K prompts across ChatGPT search, Google AI Mode, Perplexity. Reddit and Wikipedia are still ChatGPT's two most-cited domains.","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"Over 100M AI citations from 230K prompts across ChatGPT search, Google AI Mode, and Perplexity, July 14 to October 12, 2025; Reddit and Wikipedia as ChatGPT's top-cited domains; the mid-September drop in Reddit and Wikipedia share.","domain":"semrush.com","publisherName":"Semrush"},{"title":"AI citation volatility by industry: one-shot checks miss the signal","url":"https://parse.gl/research/ai-citation-volatility-by-industry","excerpt":"Two repeat ChatGPT answers to the same prompt shared only 21.2% of cited domains on average. Google AI Overviews was steadier, but still shared only 31.5% of sources.","quoteText":null,"sourceRole":"INDEPENDENT","verifiedAt":"2026-08-09T00:00:00","supportsText":"693,509 answers across 16,143 ChatGPT prompts and 15,805 AI Overviews prompts, March 26 to April 25, 2026; 21.2% and 31.5% domain overlap between repeat answers; source churn above 75% in every industry.","domain":"parse.gl","publisherName":"Parse"}],"revisions":[],"relatedAnswers":[{"id":"e99a45a2-0ef5-45e5-bec8-f6d813825f8c","slug":"what-offsite-signals-matter-for-aeo","question":"What off-site signals matter for AEO?","publishedAt":"2026-08-26T14:15:07.644","confidenceScore":76,"confidenceLabel":"Medium","industry":{"id":"70ea3802-1fc6-4fd7-a505-140d38d1c74a","slug":"digital-marketing","label":"Digital Marketing","description":"SEO, content, demand gen, and growth marketing"},"topic":{"slug":"answer-engine-optimization","label":"Answer Engine Optimization","description":"How B2B teams get content selected and cited by AI answer engines.","schemaKind":null},"contributor":{"id":"ec39deab-44fe-48d8-9029-fefe993ab85a","slug":"answer-stack","displayName":"AnswerStack","websiteUrl":null},"snippet":"Branded mentions, review corpus, third-party comparisons, community threads, earned media, and entity consistency are the six off-site signals with published evidence behind them. The quality of that evidence is uneven: a little is documented platform behavior, some is buyer survey data, and most is correlation from companies selling AI visibility tools. This breaks down what each signal is actually supported by, how long it takes to move, and the order most teams should work through them.","url":"/q/what-offsite-signals-matter-for-aeo"},{"id":"051baa33-8c61-42b3-8763-ea8a0267f827","slug":"what-makes-ai-engines-recommend-a-brand","question":"What makes AI engines recommend one brand over another?","publishedAt":"2026-08-24T14:15:05.494","confidenceScore":82,"confidenceLabel":"High","industry":{"id":"70ea3802-1fc6-4fd7-a505-140d38d1c74a","slug":"digital-marketing","label":"Digital Marketing","description":"SEO, content, demand gen, and growth marketing"},"topic":{"slug":"answer-engine-optimization","label":"Answer Engine Optimization","description":"How B2B teams get content selected and cited by AI answer engines.","schemaKind":null},"contributor":{"id":"ec39deab-44fe-48d8-9029-fefe993ab85a","slug":"answer-stack","displayName":"AnswerStack","websiteUrl":null},"snippet":"A cross-platform evidence map of why ChatGPT, Gemini, Perplexity, and Google's AI answers surface one brand instead of another. It separates what platforms actually document (index eligibility, crawler access, organic shopping results) from what correlational studies suggest (mention volume, listicle presence, reviews, rankings, freshness), with effect sizes drawn from studies covering 680 million citations, 75,000 brands, and 1.4 million prompts, plus the volatility data showing why these drivers shift month to month.","url":"/q/what-makes-ai-engines-recommend-a-brand"},{"id":"027226b0-7f49-42e5-924e-5a870eef73d9","slug":"how-far-aeo-extends-into-buyer-journey","question":"How far does AEO extend into the buyer journey?","publishedAt":"2026-08-21T14:15:05.932","confidenceScore":85,"confidenceLabel":"High","industry":{"id":"70ea3802-1fc6-4fd7-a505-140d38d1c74a","slug":"digital-marketing","label":"Digital Marketing","description":"SEO, content, demand gen, and growth marketing"},"topic":{"slug":"answer-engine-optimization","label":"Answer Engine Optimization","description":"How B2B teams get content selected and cited by AI answer engines.","schemaKind":null},"contributor":{"id":"ec39deab-44fe-48d8-9029-fefe993ab85a","slug":"answer-stack","displayName":"AnswerStack","websiteUrl":null},"snippet":"AI assistants now answer questions at every stage of a purchase, from problem framing to checkout and returns. This answer maps the evidence stage by stage: what buyers ask assistants at each point, which sources answer engines actually cite as the journey progresses, and the content each stage requires, using verified 2025-2026 data from Forrester, Bain, G2, Salesforce, Semrush, Ahrefs, xfunnel, and platform documentation from Google, OpenAI, and Stripe.","url":"/q/how-far-aeo-extends-into-buyer-journey"},{"id":"80dc7199-b930-4653-b739-1a86657e737f","slug":"which-ai-platforms-should-aeo-target","question":"Which AI platforms should an AEO strategy target?","publishedAt":"2026-08-19T14:15:05.417","confidenceScore":84,"confidenceLabel":"High","industry":{"id":"70ea3802-1fc6-4fd7-a505-140d38d1c74a","slug":"digital-marketing","label":"Digital Marketing","description":"SEO, content, demand gen, and growth marketing"},"topic":{"slug":"answer-engine-optimization","label":"Answer Engine Optimization","description":"How B2B teams get content selected and cited by AI answer engines.","schemaKind":null},"contributor":{"id":"ec39deab-44fe-48d8-9029-fefe993ab85a","slug":"answer-stack","displayName":"AnswerStack","websiteUrl":null},"snippet":"Reach data, citation behavior, and audience fit for every major answer engine as of mid-2026: Google's AI Overviews, AI Mode, and Gemini, plus ChatGPT, Perplexity, Microsoft Copilot, Claude, and Meta AI. Includes a platform comparison table, a prioritization framework by audience type, and the crawler settings that decide whether each platform can cite your site at all.","url":"/q/which-ai-platforms-should-aeo-target"}],"contributorStats":{"verifiedAnswers":269,"openDisputes":0},"schemaJson":{"@context":"https://schema.org","@type":"Question","name":"What are the biggest AEO mistakes to avoid?","text":"What are the biggest AEO mistakes to avoid?","url":"https://www.answerstack.io/q/biggest-aeo-mistakes-to-avoid","answerCount":1,"datePublished":"2026-08-28T14:15:04.474","author":{"@type":"Person","name":"AnswerStack Editorial Team","worksFor":{"@type":"Organization","name":"AnswerStack"},"url":"https://www.answerstack.io/contributors/answer-stack"},"about":[{"@type":"Thing","name":"Answer Engine Optimization"},{"@type":"Thing","name":"Digital Marketing"}],"acceptedAnswer":{"@type":"Answer","text":"The most expensive AEO mistakes remove a site from the candidate pool before content quality matters: blocking the crawlers that feed AI answers, publishing pages that fall under Google's scaled content abuse policy [2], and leaving main content in client-side JavaScript that no major AI crawler executes [11]. Access rules are easy to get wrong because every platform separates its search crawler from its training crawler, so disallowing GPTBot only signals a training opt-out while disallowing OAI-SearchBot removes a site from ChatGPT search answers [7], and a CDN-level block on training crawlers can now catch Googlebot as well [9]. The second cluster of mistakes is measurement, since Search Console's generative AI report gives impressions with no clicks and no average position [5], and Google Analytics only recently began grouping AI assistant arrivals into their own channel while still excluding AI Overviews and AI Mode [6]. Judging the program by referral volume is the most common misread of all: AI-referred traffic sat at 0.2% of visits across 6,500 sites in Contentsquare's 2026 benchmark [14], while Ahrefs recorded 0.5% of its own traffic producing 12.1% of signups [13].","url":"https://www.answerstack.io/q/biggest-aeo-mistakes-to-avoid","upvoteCount":0,"datePublished":"2026-08-28T14:15:04.474","dateModified":"2026-08-09T00:00:00","author":{"@type":"Person","name":"AnswerStack Editorial Team","worksFor":{"@type":"Organization","name":"AnswerStack"},"url":"https://www.answerstack.io/contributors/answer-stack"},"citation":[{"@type":"CreativeWork","name":"AI features and your website","url":"https://developers.google.com/search/docs/appearance/ai-features"},{"@type":"CreativeWork","name":"Spam Policies for Google Web Search","url":"https://developers.google.com/search/docs/essentials/spam-policies"},{"@type":"CreativeWork","name":"Google Common Crawlers (including Google-Extended)","url":"https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers"},{"@type":"CreativeWork","name":"Search generative AI control","url":"https://support.google.com/webmasters/answer/16908024?hl=en"},{"@type":"CreativeWork","name":"Generative AI performance report (Search)","url":"https://support.google.com/webmasters/answer/16984139?hl=en"},{"@type":"CreativeWork","name":"Default channel group","url":"https://support.google.com/analytics/answer/9756891?hl=en"},{"@type":"CreativeWork","name":"OpenAI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User)","url":"https://developers.openai.com/api/docs/bots"},{"@type":"CreativeWork","name":"Does Anthropic crawl data from the web, and how can site owners block the crawler?","url":"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler"},{"@type":"CreativeWork","name":"Your site, your rules: new AI traffic options for all customers","url":"https://blog.cloudflare.com/content-independence-day-ai-options/"},{"@type":"CreativeWork","name":"Control content use for AI training with Cloudflare's managed robots.txt and blocking for monetized content","url":"https://blog.cloudflare.com/control-content-use-for-ai-training/"},{"@type":"CreativeWork","name":"The rise of the AI crawler","url":"https://vercel.com/blog/the-rise-of-the-ai-crawler"},{"@type":"CreativeWork","name":"Ahrefs study: AI Overview citations vs. top-10 rankings (863,000 keywords, 4 million cited URLs)","url":"https://ahrefs.com/blog/ai-overview-citations-top-10/"},{"@type":"CreativeWork","name":"Does AI Search Traffic Convert Better Than Traditional Search? For Ahrefs, Yes: 0.5% of Visitors Drove 12.1% of Signups","url":"https://ahrefs.com/blog/ai-search-traffic-conversions-ahrefs/"},{"@type":"CreativeWork","name":"What Is AI-Referred Traffic? 2026 Benchmarks","url":"https://contentsquare.com/blog/ai-referred-traffic/"},{"@type":"CreativeWork","name":"The Most-Cited Domains in AI: A 3-Month Study","url":"https://www.semrush.com/blog/most-cited-domains-ai/"},{"@type":"CreativeWork","name":"AI citation volatility by industry: one-shot checks miss the signal","url":"https://parse.gl/research/ai-citation-volatility-by-industry"}]}}}