Skip to content
Answer Stack
Open menu

What are the biggest AEO mistakes to avoid?

✓ Verified Last reviewed by AnswerStack Next review due Dec 14, 2026

Every claim is sourced below

The biggest AEO mistakes are blocking the search access you wanted to keep, publishing formulaic page variants where useful evidence should be, treating schema as a guarantee of citations, and reading a sampled mention as a business result. That's our order of priority. Access comes first because a blocked page isn't eligible for a product's search answers at all. Evidence and markup come next, since they bear on whether an eligible page gets used. Measurement comes last: a citation you can't connect to a visit or a lead leaves the business effect unestablished.

Mistake What it costs Where to look
Blocking search access you wanted Your pages aren't eligible for that product's search answers robots.txt and the generative AI control in Search Console
Formulaic variants in place of evidence Many pages that say what other pages already say The page plan, before anything is written
Schema treated as a citation guarantee Time spent on markup while larger gaps stay open The priority list for technical work
A sampled mention read as a result Decisions made on visibility with no link to revenue The report that goes to whoever funds the work

Blocking the search access you wanted to keep

An accidental block can start with a reasonable decision: you don't want your content used to train AI models. The mistake is carrying out that decision with a rule that also covers search.

OpenAI's crawler documentation shows why the two have to be handled separately. It describes OAI-SearchBot as the crawler that surfaces sites in ChatGPT's search features, and GPTBot as the one that collects content for training. Each setting is independent. A site can allow the first and disallow the second. But a site that opts out of OAI-SearchBot won't be shown in ChatGPT search answers, though it can still appear as a navigational link. So a robots.txt rule that disallows both crawlers, written with only training in mind, gives up the search answers as well.

Google has its own version of this. Since August 31, 2026, every Search Console property has a generative AI control that includes or excludes the site from AI Overviews, AI Mode and the generative features in Discover. Include is the default. A property with a parent inherits the parent's choice by default, so a setting made on the parent applies to the child until the child is configured separately.

This exclusion is easy to miss. Google says the control isn't a ranking or inclusion signal for the rest of Search, so a site can be excluded from AI answers and remain eligible everywhere else. The control also doesn't govern training, and Google points to a separate one, Google-Extended, for that. Excluding a site over a training concern gives up the AI features without addressing the concern.

Getting access right removes one barrier, and that's all it does. Google says plainly that indexing and serving aren't guaranteed even when a page meets every requirement. Other products document their own crawlers, and we cover those in which AI platforms an AEO strategy should target.

Publishing variants where evidence should be

The second mistake is trying to cover every way a question can be phrased with a separate page. It feels like diligence, and it produces a lot of pages quickly.

Google's guide to optimizing for AI search names this directly. Creating separate content for every variation of a search, done mainly to manipulate rankings or AI responses, violates its scaled content abuse policy. That policy describes many pages generated mainly to manipulate rankings, with little value for the reader, no matter how they were created. So writing with AI isn't the offense, and neither is a second page on a related question. Purpose and value decide it.

The guide also explains why the variants don't help. Google's systems understand synonyms and general meaning, so they can connect a search to a page that doesn't use the same words. Rewording one answer across a dozen pages isn't needed for those searches to find it. What Google says does help is what it calls non-commodity content: a point of view or first-hand experience that the other sources lack.

Suppose your sales team keeps hearing one question: how long will it take to move our 400-page site to a new CMS? Suppose, too, that you have records from past migrations. The formulaic plan writes one page for a 100-page site, another for a 200-page site and one more for each CMS, each restating general advice. The other plan writes one answer from those records. It gives the range of timelines in them, says what stretched the long ones, and sets out an estimate for a 400-page site. That page carries information the general advice doesn't have.

Where the questions come from matters too. Lean Labs' description of its AEO work starts with a managed question set built from sales calls, CRM insights and Search Console demand. It then describes expert-led answers connected to supporting proof. Starting from questions buyers have asked gives each planned page a reason to exist that you can point to.

Treating schema as a citation guarantee

Structured data is worth having. The mistake is believing it earns citations, and scheduling it ahead of work that matters more.

Google's guide says structured data isn't required for generative AI search and that there's no special schema.org markup to add. It still recommends structured data as part of ordinary SEO, because it helps pages qualify for rich results, and it asks that the markup match the visible text. The same guide says Google Search ignores llms.txt files, and that you don't need to break content into small chunks or rewrite it in a special style for AI. Those statements are about Google Search. Other services can use such files, and the guide says so.

So schema belongs on the list as one item of technical upkeep. The technical step in Lean Labs' process lists schema and entity clarity alongside crawl health and indexing checks. Markup describes a page. It doesn't make an unindexed page eligible, and Google doesn't present it as a route into AI answers. We go further into what markup does in what role structured data plays in AEO.

Reading a sampled mention as a business result

Someone types a question into an AI product, sees the company named, and takes a screenshot. That's a sample of one answer on one day. Google notes that AI Overviews and AI Mode may use different models and techniques, so the two can show different responses and links. A screenshot from one doesn't tell you what the other showed.

Google's generative AI performance report in Search Console counts impressions, meaning the number of times a link to your site was shown in AI Overviews or AI Mode. You can group them by page, country, date or device. An impression is a link on a screen. It isn't a visit, and it isn't a lead.

The fix is to keep three things in separate columns and report them together: whether you were shown or cited, whether anyone came, and what those visitors did. Lean Labs describes its measurement in those layers: mentions, citations and prompt coverage first, then AI referral traffic and engaged visits, then the contacts, deals and pipeline recorded in the HubSpot CRM. The value of that arrangement is that a rise in the first layer can't pass for a rise in the third.

It also tells you what to investigate when the numbers disagree. If citations rise and visits don't, people could be getting what they need from the answer, the tracking could be missing visits, or the cited pages could be ones a buyer has no need to open. If visits rise and contacts don't, look at who is arriving and where they land, and allow for the time your buyers take to make contact. We describe the tracking setup in how to track traffic and referrals from AI answer engines.

Sources

Optimizing your website for generative AI features on Google Search

Google Search Central

Primary source Verified Sep 14, 2026 Supports: Search operator documentation, last updated July 10, 2026: eligibility conditions (technical requirements, indexed, snippet-eligible, included under Search Console generative AI settings); indexing and serving not guaranteed; no machine-readable AI files, llms.txt, chunking, AI-specific writing styl

“You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search. Structured data isn't required for generative AI search.”

Spam Policies for Google Web Search

Google Search Central

Primary source Verified Sep 14, 2026 Supports: Definition of scaled content abuse, the generative-AI example, and the statement that the policy applies no matter how the content was created. Page last updated August 28, 2026.

“Scaled content abuse is when many pages are generated for the primary purpose of manipulating search rankings and not helping users... no matter how it's created.”

Search generative AI control

Google Search Console Help

Primary source Verified Sep 14, 2026 Supports: The control excludes a site from AI Overviews, AI Mode, and generative AI features in Discover; it is not a ranking or inclusion signal for the rest of Search; noindex is still required to block Search itself. Rolled out worldwide August 31, 2026.

“This control only affects whether your content can appear in certain Search generative AI features; this control isn't used as a ranking or inclusion signal affecting other parts of Search.”

Generative AI performance report (Search)

Google Search Console Help

Primary source Verified Sep 14, 2026 Supports: The report covers impressions from AI Overviews and AI Mode with no click data and no average position, and excludes Search Labs experiments. Rolled out worldwide August 31, 2026, which sets the maximum history available in September 2026.

“Search Console doesn't include data from experiments in Search Labs, as these experiments are still in active development.”

Default channel group

Google Analytics Help

Primary source Verified Sep 14, 2026 Supports: GA4's AI Assistant default channel, the sources it recognizes, its ai-assistant medium and AI-referrer matching rules, and its exclusion of Google AI Overviews and AI Mode. The page gives no introduction date for the channel.

“AI Assistant is the channel by which users arrive at your site from sources like ChatGPT, Gemini, Deepseek, Copilot, or Grok. It excludes Google's AI Overviews and AI Mode.”

OpenAI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User)

OpenAI

Primary source Verified Sep 14, 2026 Supports: OAI-SearchBot governs appearance in ChatGPT search answers, with opted-out sites still able to appear as navigational links; GPTBot governs training data collection only; ChatGPT-User handles user-initiated fetches.

“Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links. Disallowing GPTBot indicates a site's content should not be used in training generative AI foundation models.”

Does Anthropic crawl data from the web, and how can site owners block the crawler?

Anthropic

Primary source Verified Sep 14, 2026 Supports: ClaudeBot collects content for model training, Claude-SearchBot improves search result quality, and Claude-User serves user-directed retrieval; the documented effect of disabling Claude-SearchBot.

“Disabling Claude-SearchBot... may reduce your site's visibility and accuracy in user search results.”

Your site, your rules: new AI traffic options for all customers

Cloudflare

Primary source Verified Sep 14, 2026 Supports: Product documentation for Cloudflare's own bot controls, published July 1, 2026: Search, Agent, and Training categories; the most-restrictive-rule behavior that blocks multi-purpose crawlers including Googlebot, Applebot, and BingBot when Training is blocked (current behavior); and the announced Sep

“Multi-purpose crawlers such as Googlebot, Applebot, and BingBot will be blocked by customers who have selected to block Training.”

Control content use for AI training with Cloudflare's managed robots.txt and blocking for monetized content

Cloudflare

Supporting Verified Sep 14, 2026 Supports: Vendor-published network measurement, July 1, 2025: crawl-to-referral ratios of roughly 1,700:1 for OpenAI, 73,000:1 for Anthropic, and about 14:1 for Google in June 2025. Cloudflare sells the crawler-control products the post launches, which is a commercial interest in the framing.

“In June 2025, OpenAI's crawl-to-referral ratio was 1,700:1, Anthropic's 73,000:1.”

The rise of the AI crawler

Vercel (with MERJ)

Supporting Verified Sep 14, 2026 Supports: Vendor-published measurement of Vercel network traffic, December 17, 2024: OpenAI, Anthropic, Meta, ByteDance, and Perplexity crawlers do not render JavaScript; Google's Gemini and Applebot are explicitly excluded from that finding; ChatGPT fetched JS files on 11.50% of requests and Claude on 23.84%

“None of the major AI crawlers currently render JavaScript. This includes: OpenAI (OAI-SearchBot, ChatGPT-User, GPTBot), Anthropic (ClaudeBot), Meta (Meta-ExternalAgent), ByteDance (Bytespider), Perplexity (PerplexityBot).”

What Is AI-Referred Traffic? 2026 Benchmarks

Contentsquare

Independent Verified Sep 14, 2026 Supports: Cross-industry benchmark published April 3, 2026 from 99 billion sessions across 6,500 sites: AI-referred traffic at 0.2% of total visits, up 632% year over year, converting at 1.3% in 2025 against 1.9% for email. Contentsquare sells digital experience analytics and has no stake in the AEO tooling m

“AI-referred traffic still represents just 0.2% of total visits... AI-referred traffic converted at 1.3% in 2025, a 55% increase year over year.”

Does AI Search Traffic Convert Better Than Traditional Search? For Ahrefs, Yes: 0.5% of Visitors Drove 12.1% of Signups

Ahrefs

Supporting Verified Sep 14, 2026 Supports: One company's own first-party data, published June 16, 2025: 0.5% of Ahrefs traffic from AI search over the prior 30 days (0.3% year to date) producing 12.1% of signups, calculated as 23x the conversion rate of its traditional organic traffic; plus the author's stated doubt that the multiple scales.

“My gut tells me it won't be quite that good... click-through rates are probably the highest they'll ever be as the novelty of this format wears off.”

The Most-Cited Domains in AI: A 3-Month Study

Semrush

Supporting Verified Sep 14, 2026 Supports: Vendor study published November 10, 2025: over 100M AI citations from 230K prompts across ChatGPT search, Google AI Mode, and Perplexity in weekly snapshots from July 14 to October 12, 2025; Reddit and Wikipedia as ChatGPT's top two cited domains ahead of Medium, Forbes, and LinkedIn; ChatGPT's Redd

“ChatGPT cited Reddit in close to 60% of prompt responses in early August before collapsing to around 10% by mid-September.”

AI citation volatility by industry: one-shot checks miss the signal

Parse

Supporting Verified Sep 14, 2026 Supports: Vendor study published July 8, 2026: 693,509 answers across 16,143 ChatGPT prompts and 15,805 Google AI Overviews prompts between March 26 and April 25, 2026; repeat ChatGPT answers to the same prompt sharing 21.2% of cited domains on average and AI Overviews 31.5%; ChatGPT source churn from 75.4% (

“Two repeat ChatGPT answers to the same prompt shared only 21.2% of cited domains on average. Google AI Overviews was steadier, but still shared only 31.5% of sources.”

Revision history

1 revision since publication
Originally published