How AI Search Engines Work: RAG Architecture Explained

Every AI search engine — ChatGPT Search, Perplexity, Google AI Overviews, Google AI Mode, Claude, and Gemini — runs on the same underlying architecture: Retrieval-Augmented Generation (RAG). First formally described by Lewis et al. at NeurIPS 2020, RAG has become the standard method for grounding LLM outputs in retrieved evidence rather than model memory alone. Updated September 2026: the four-stage model below is still the correct map of the pipeline, but four new results — Google's first official guidance, a failed replication of the Princeton tactics, a Perplexity citation-log audit, and a five-engine overlap study — now require specific caveats at each stage.

Understanding RAG matters for GEO because every citation decision happens inside this pipeline. If your content fails at any of the four stages — query understanding, retrieval, re-ranking, or generation — it will not appear in AI search answers. There is no "the LLM went and found my content on its own" scenario. The pipeline determines what gets cited, and understanding each stage tells you precisely where to invest optimization effort.

Mid-2026 corroboration keeps mounting. Independent GEO research (Omnius AI Search & GEO Report 2026) estimates AI search now spans ~45B monthly sessions worldwide, with 80%+ of Google searches ending without a click. The GEO tooling market is maturing fast in parallel — Profound, a dedicated AI-citation tracking platform, reached a $1B valuation in February 2026. By mid-2026 the three largest assistants were ChatGPT (~1.1B MAU), Gemini (~662M MAU), and Claude (~245M MAU) — a three-way split (Sensor Tower, "State of AI Report 2026", June 2026) that makes multi-engine RAG optimization mandatory. The practical takeaway for RAG-stage optimization is unchanged: freshness, factual density, and structure are what survive retrieval and re-ranking at scale — and now they compete for a far larger audience.

September 2026 update: what the four-stage model got right — and where it now needs caveats

The four-stage RAG model still describes how AI search works — but four 2026 results force material caveats at each stage. Google published its first official guidance on generative AI features and confirmed there is no separate AI index. A replication of the Princeton tactics failed to reproduce them on modern engines. A citation-log audit found Perplexity draws most of its evidence from domains almost no human visits. And a five-engine study found only 8% source overlap between platforms. Each finding maps to exactly one stage of the pipeline below.

Stage 1 — query understanding: intent type decides whether you are citable at all

Google AI Mode now varies its citation behaviour by intent, not just by topic. Nicholas Sitter's 2026 analysis found entity-wrapped citations appear on 87.6% of recommendation-style prompts, 19.8% of explanatory prompts, and 0% of generic informational queries. Combined with query fan-out of up to 16 sub-searches per answer, the practical rule is blunt: tag and report your prompts by buyer stage, because a generic informational page has a near-zero chance of an entity-wrapped citation in AI Mode. Query understanding is where citable intent is won or lost — before retrieval ever runs.

Stage 2 — retrieval: the evidence layer is far less authority-filtered than assumed

Trellner Research (TR-2026-009, published September 2, 2026) queried Perplexity's sonar and sonar-pro models across 380 software buyer-intent categories in 760 API calls, returning 7,534 citations from 2,055 distinct domains. The result inverts the usual authority assumption: 59.8% of citations pointed to domains ranked worse than #100,000 globally, and 23.4% pointed to domains outside the top million entirely. Wikipedia appeared 3 times in the full set; the most-cited domains were g2.com (291), reddit.com (261), guideflow.com (194) and gartner.com (158). Trellner also identified three near-identical sites holding 215,128 machine-generated "best software" pages, two of which title their homepages "Facts & Grounding Page." The study's own conclusion is the line worth quoting: "An AI cited it is not the same claim as a person vetted it." Retrieval rewards a passage that matches the query — not a domain that deserves to rank.

Stage 3 — re-ranking: the Princeton effects did not replicate on modern engines

Bajemon and Rochet (arXiv preprint, September 7, 2026) re-tested three of the original GEO interventions with paired, volume-controlled edits. None produced a positive pooled effect. Adding quotations measured −0.325 percentage points (95% CI −0.841 to 0.171, n=1,531); adding statistics −0.276 pp (95% CI −0.970 to 0.425, n=1,087); and adding source citations −0.793 pp (95% CI −1.533 to −0.138, n=1,087 — the only interval that excludes zero). Separately, a deterministic query-blind page score built from 11 text features correlated only 0.114 (pooled within-query Spearman, n=777) with citation visibility, and replicated at 0.118 on three GPT-5.x arms — while query-conditioned models reached roughly 0.37–0.38. Read this precisely: it does not mean "GEO does not work." It means re-ranking is query-conditioned — a page-level quality signal cannot predict an ordering that depends on the query.

Stage 4 — generation: retrieved is not cited, and cited is not chosen

Two 2026 results separate stages that GEO reporting habitually collapses into one number. Testing Claude via API web search, named-brand sites were retrieved in only 33% of run-brand pairs, yet 62.7% of retrieved domains went on to be cited — so retrieval and citation are distinct metrics requiring distinct dashboards. And Latent Space's Frontier AI visibility tracker (6,762 answers, 161 categories) found Kysely appeared in 42 of 42 answers but was the first choice exactly once, with category leaders differing between models in 33 of 121 comparable categories. Mention is not choice. Layer citation volatility on top: across 536 prompt-engine combinations with five or more checks each, 80% of appearance cases were inconsistent, and a single check matched the majority only 72.2% of the time — which is why practitioners now target 30–40 runs per prompt before treating a visibility number as real.

The four stages of RAG — and where most content gets eliminated

All major AI search systems run the same four-stage pipeline. Understanding each stage explains exactly why some content gets cited and most does not:

1. 1.
   Query understanding

   The user's natural language query is parsed for search intent and may be decomposed into multiple sub-queries. For example, "best GEO strategies 2026" may be fanned out into "GEO optimization strategies," "GEO statistics 2026," and "GEO research 2026" — each running through the entire pipeline independently. Google AI Mode uses query fan-out of up to 16 sub-searches per answer (Presenc AI, June 2026). Content covering only one angle of a multi-faceted query may miss citation opportunities on the other sub-queries.

2. 2.
   Retrieval — where 80%+ of content is eliminated

   The engine runs two parallel retrieval methods:

   • Vector search (dense retrieval) — both query and indexed passages are converted into embeddings (typically 768–1536 dimensions) and compared by cosine similarity. This matches by meaning, not exact words. A query about "how to optimize for AI search" can match content discussing "GEO strategies" even if the exact phrase never appears.
   • BM25 keyword search (sparse retrieval) — a probabilistic model scoring passages by term frequency, inverse document frequency, and document length. This catches exact brand names, version numbers, technical terms, and named entities that vector search might blur.

   The two result sets are fused — commonly using Reciprocal Rank Fusion (RRF) — and the engine pulls 20–100 candidate passages from the index. Pages not crawled, or blocked by robots.txt, are eliminated before this stage even begins. Content written too vaguely (missing key terms) or too narrowly (no semantic breadth) tends to underperform in hybrid retrieval.

3. 3.
   Re-ranking — the GEO decider

   20–100 candidates are still too many. A cross-encoder model reads each candidate passage's full text alongside the user query and outputs a relevance score. Unlike vector search (which compresses text into embeddings), the cross-encoder actually "reads" the content — making it sensitive to writing quality, factual density, and structure.

   Authority signals and content structure quality are layered in at this stage. The final shortlist retains 3–15 highest-scoring passages. This is the stage the Princeton GEO study (Aggarwal et al., KDD 2024) measured directly: expert quotations (+41% visibility), statistics (+33%), cited sources (+28%), fluency (+29%). Content freshness also matters here: pages updated within 30 days receive a 2.8× citation multiplier, while content older than one year drops to 0.6× baseline (ConvertMate/Semrush 2026). Keyword stuffing scores −8% — the cross-encoder detects the unnatural density signal.

4. 4.
   Generation + citation — the final gate

   The LLM reads the 3–15 surviving passages, synthesizes an answer, and decides which sources to cite in the response. This decision is governed by five factors — factual density, source authority, information uniqueness, content structure, and semantic consistency (detailed below). Crucially: if your content did not make the 3–15 passage shortlist, it cannot be cited. There is no secondary "go search the web" mechanism. SparkToro research (Jan 2026) shows that 44.2% of all LLM citations come from the first 30% of content — making strong introductions critical.

2026 data underscores the importance of content freshness throughout the RAG pipeline. The ConvertMate/Semrush joint study found that content updated within 30 days receives a 2.8× citation probability multiplier, 31–90 days receives 1.9×, and content older than one year drops to 0.6× baseline — a −40% penalty. This means stale content that passes retrieval still underperforms at the re-ranking stage — and is a key reason daily content updates matter for GEO.

"RAG is not magic. It is a well-defined information processing pipeline with explicit stages. If you know what each stage does and how it screens content, you know exactly where to invest optimization effort. The Princeton GEO study was the first to quantify these effects at the re-ranking stage, but every subsequent study — from BrightEdge, ConvertMate, and Authoritas — has confirmed the same pattern: authority signals, factual density, and content structure are what separate cited content from invisible content."

Hybrid retrieval: why both vector search and BM25 matter

A common misconception is that "semantic matching has made keyword search obsolete." This is incorrect. Vector search and BM25 solve complementary problems:

Vector search excels at matching paraphrased concepts — it can connect "how do I get cited by AI?" to "GEO citation optimization strategies." But it is insensitive to rare entities. A deep review of a niche tool with specific version numbers, command-line arguments, and proprietary terminology may be vector-matched to a generic "developer tools comparison" because they sit at similar coordinates in embedding space.

BM25 solves this by weighting term frequency. That niche tool name, "v2.3.1", and specific API parameter get high BM25 scores that pull the article into the candidate set regardless of embedding proximity.

The practical implication: natural, fluent writing that correctly uses domain terminology outperforms both keyword-stuffed and purely abstract content. You need to score in both retrieval dimensions simultaneously. This also explains why the Princeton study found fluency optimization (+29%) performs nearly as well as statistics addition (+33%) — fluent writing produces cleaner passages that both retrieval methods score higher.

What the Princeton GEO study actually found at the re-ranking stage

The landmark paper "GEO: Generative Engine Optimization" (Aggarwal, Dugan et al., Princeton / IIT Delhi / Georgia Tech, KDD 2024) tested 9 content modification strategies on 10,000 real queries across 9 datasets. The study measured visibility as position-adjusted word count in AI-generated answers — the first rigorous benchmark of what drives AI citations:

Source: Aggarwal et al., "GEO: Generative Engine Optimization," arXiv:2311.09735, KDD 2024. Visibility measured by position-adjusted word count on GEO-bench (10,000 queries, 9 datasets). Validation studies: GrackerAI "State of GEO 2026," Conductor AEO/GEO Benchmarks (2026), BrightEdge Citation Signals (2026). · Google AI Mode & AI Overviews Updates (Jan 2026) · Google I/O 2026 Search Updates (May 2026).

The +41% for expert quotations is particularly revealing. A named, attributable opinion — "Dr. Jane Smith, Professor at Stanford, states that..." — scores higher than the same factual content presented as anonymous prose. The cross-encoder likely learns this pattern from training data where attributed statements correlate with higher-quality sources. Keyword stuffing at −8% is notable because in traditional SEO it is at worst neutral (wasted effort but not harmful). In GEO, it is an active penalty — the cross-encoder reads the full text and detects the unnatural density.

The five factors determining citation selection

Once the LLM has 3–15 high-scoring passages from re-ranking, it decides which to cite in the generated answer. Based on research and reverse-engineering, five factors govern this decision:

1. 1.
   Factual density — Specific numbers, dates, version numbers, and named entities are extracted more reliably and cited more frequently. "Conversion rate improved by approximately one quarter" is far less likely to be cited than "conversion rate improved 24% (n=1,000, p<0.01)." Vague language reliably loses to precise language at this stage.
2. 2.
   Source authority — Named authors, institutional affiliations, and existing external citations all signal trustworthiness. Personal blogs and independent creators can compete here — the key is making authority explicit rather than anonymous.
3. 3.
   Information uniqueness — Original data, proprietary research, and first-hand analysis are cited significantly more often than paraphrased content. If you are summarizing what others have already published, the AI engine will likely cite the original source rather than your summary. This is the hardest factor to optimize but has the highest long-term value.
4. 4.
   Content structure — FAQ blocks, comparison tables, numbered lists, and clear heading hierarchies make passages easier for LLMs to extract as discrete citation units. Unstructured walls of text are the least citable format. Structured data (Schema.org) boosts AI search citations by +44% (BrightEdge 2026).
5. 5.
   Semantic consistency — The passage must match both the user query intent and the LLM's current answer framing. High-quality content that diverges from the answer's direction may still go uncited.

Factors 1 and 3 are the most commonly overlooked by content creators. Many invest heavily in factor 4 (adding FAQ blocks, tables, structured data) but fill those structures with generic claims. Factual density and information uniqueness are the real thresholds — structure amplifies their effect but cannot substitute for them.

Index fragmentation: why each engine requires separate optimization

A persistent misconception is that "AI search uses Google's index." It does not — with a single exception. Each AI engine maintains its own independent index:

• ▸ Google AI Overviews — reuses the Googlebot index (the only exception)
• ▸ Google AI Mode — 13.7% URL overlap with AI Overviews (Presenc AI, June 2026) — essentially a separate index
• ▸ ChatGPT Search — retrieves from the Bing index (OpenAI/Microsoft), so Bing Webmaster Tools setup is now an AEO non-negotiable; IndexNow accelerates freshness on that index
• ▸ Perplexity — built by PerplexityBot, fully independent
• ▸ Claude — three crawlers: ClaudeBot, Claude-User, and Claude-SearchBot

Google confirmed the same point from the opposite direction in its first official generative-AI optimization guide (2026, announced by John Mueller): AI Overviews and AI Mode pull from the same crawled, indexed pages as classic results — there is no separate AI index. Google also said you can ignore "AEO/GEO hacks" such as content chunking and AI-specific rewriting, and that an llms.txt file neither helps nor harms you on Google Search. On Google surfaces, crawl access is therefore the whole game — everything downstream is ranking, not indexing.

Cross-engine overlap is now measured rather than assumed. Intender's 2026 study of 27,924 citations drawn from 3,600 searches across five engines found only 8% overlap across all five platforms — 71% of the 4,625 cited domains appeared on a single engine, and just 65 domains appeared on all five. There is no single AI citation ecosystem to win; there are five, and they barely agree.

This means ranking #1 in Google organic search does not guarantee visibility in ChatGPT Search — and the reverse is also true. Because ChatGPT Search is built on Bing's index, optimizing for Bing (via Bing Webmaster Tools and IndexNow) is now a direct, independent lever for ChatGPT Search visibility, separate from your Google SEO work. Blocking OAI-SearchBot in robots.txt while allowing Googlebot effectively opts your content out of the largest AI search channel by traffic.

Citation overlap between engines is low. The same query on ChatGPT Search and Perplexity often produces completely different citation lists — a phenomenon confirmed by the Axis Intelligence AI Search Fragmentation Index (ASFI™), which showed market concentration declining 50.5% over 12 months as platforms diverge in their citation behavior. Claude's B2B referral share of 18.5% (Goodie Wave 2 report, 41 brand sites, 2.8M AI referral sessions) is roughly 3.7× its global average, reinforcing that platform-specific optimization is essential.

Action checklist: what to optimize at each RAG stage

Translating the technical pipeline into actionable steps:

• ▸ Ensure crawlability — Allow OAI-SearchBot, PerplexityBot, Claude-SearchBot, ClaudeBot, Google-Extended, and Gemini crawlers in robots.txt. Five minutes of configuration that many sites skip.
• ▸ Optimize for vector retrieval — Write naturally, cover relevant entities, use domain terminology correctly. Professional writing performs well in embedding space without deliberate "semantic optimization."
• ▸ Optimize for BM25 retrieval — Use key terms, brand names, version numbers, and technical terms correctly. Avoiding term usage to prevent "keyword stuffing" is overcorrection — proper terminology is necessary for sparse retrieval.
• ▸ Boost re-ranking score — Add statistics with named sources, include expert quotations with attribution, cite authoritative sources. These three strategies have the largest verified impact on re-ranking scores.
• ▸ Make content extractable — One core point per paragraph, clear heading hierarchy, FAQ blocks for common questions, tables for comparative data. LLMs need clean, discrete citation units — not long-form prose they must summarize themselves.
• ▸ Provide unique value — The hardest and most defensible strategy. Original data, proprietary analysis, first-hand experience — content that cannot be replicated by paraphrasing someone else's work. This is ultimately the factor that makes AI engines choose your content over alternatives.

Open questions in RAG systems (2026 perspective)

Transparent research on RAG internals is limited, and acknowledging uncertainty is important. Several open questions affect GEO strategy:

How does embedding dimensionality affect retrieval quality? Engines use different dimensions (768, 1024, 1536+), but public research rarely addresses the impact of dimensionality on retrieval precision. Higher dimensions may introduce noise in smaller datasets, but the evidence is inconclusive.

What training data do cross-encoder re-rankers use? If trained on historical search click data, they inherit traditional relevance judgments. If fine-tuned on AI generation scenarios, citation criteria may differ. Engine providers do not disclose this — making strategy calibration partly empirical.

ChatGPT May 2026 link format update impact: On May 7, 2026, ChatGPT updated its link display format, causing a single-week referral spike of +157.7% (Similarweb), with homepage referrals surging +354.7%. This confirms that AI search referral traffic has not yet plateaued — as UI improves, citation traffic continues to grow.

Will multi-modal RAG change citation dynamics? Current RAG systems process text primarily. If AI engines begin indexing images, charts, and code snippets at scale — which have higher information density than text — content creators producing visual assets may gain a new citation channel. GrackerAI predicts 40%+ of AI citations will include video or chart content by end of 2026.

These uncertainties mean GEO strategies require continuous monitoring and adjustment. What works today may not yield the same results in six months as RAG systems evolve.

Frequently asked questions