Benchmark your ChatGPT and Perplexity citations before you hire

Most brands arrive at their first AEO agency call with no documented citation data at all, and in my experience benchmarking sites before engagement, fewer than one in ten can produce a measured citation rate for even two engines at the start of the conversation. That matters because citation behavior is genuinely volatile: the page an engine cites today for a specific query may not appear tomorrow for that same query, and what ChatGPT surfaces often has zero overlap with what Perplexity surfaces for identical prompts. Without your own independent baseline, any before-and-after slide a vendor shows you is unverifiable on its face.

This guide gives you a repeatable process for taking that baseline yourself, across four engines, in an afternoon. It covers what to measure, how to structure the data, and how to use the numbers to run a vendor conversation with actual accountability built in. The goal is not to skip the vendor. The goal is to walk into the engagement knowing what you actually have.

Why should you take a citation baseline before hiring anyone?

The pattern is familiar. A brand reads a few unsettling articles about AI citations, feels the anxiety that has apparently become mandatory in marketing circles, and calls an agency.

The agency sends a proposal with a 90-day roadmap and a before-and-after case study. The brand signs. Six months later, the agency delivers an updated citation snapshot showing improvement, as of September 2026.

The problem: nobody took an independent baseline at the start. The "before" numbers came from the vendor, using queries the vendor selected, run at a moment the vendor chose. Even if the agency is completely honest, the brand has no way to verify what actually moved and what simply drifted. Citation behavior is genuinely volatile. As the newsletter Duane Forrester Decodes describes it, content cited today for a query may not appear tomorrow for that same query, and this instability means you are tracking trends rather than guarantees.

There is also the cross-engine problem. One AEO practitioner running a fashion agency benchmarked the same prompt across ChatGPT, Perplexity, Gemini, and Claude and found "often zero overlap at the top." If your vendor focuses on one engine and reports a lift there, you may be losing ground somewhere else that nobody measures. I have seen this happen: a brand improves its Perplexity citations, reports success, and meanwhile ChatGPT has quietly deprioritized them for the same queries.

The fix is not complicated. Take your own baseline before you talk to anyone. It takes an afternoon. The rest of this guide shows you exactly how, what to measure, and how to use the numbers to write a vendor brief that actually holds someone accountable.

Which AI engines belong in your benchmark?

The short answer is four: ChatGPT, Perplexity, Claude, and Gemini. Here is why each one matters and why none of them behave the same way.

ChatGPT (OpenAI) is the largest by daily active users, at over 120 million. It relies on training data as a default and uses Retrieval Augmented Generation via Bing when browsing is enabled. The practical implication is that your Bing ranking matters more for ChatGPT visibility than your Google ranking. Research finds that the top result in Bing appears in ChatGPT sources for the same query 63% of the time. If GPTBot cannot crawl your site, you have a structural problem that no content optimization can fix.

Perplexity performs real-time web retrieval on every query and shows explicit citations with links. One practitioner testing a structured content approach found that Perplexity cited newly published blog posts within 2 hours of publication. ChatGPT, by contrast, was "a bit slower to recall." This makes Perplexity both the fastest engine to reflect new content and the easiest to monitor manually, since citations are visible and timestamped.

Claude (Anthropic) tends to surface for reliable information and fact-checking queries. Its citation patterns are less transparent than Perplexity's, but it represents a distinct user population with distinct intent.

Gemini is Google's AI layer and tracks closely with traditional Google search presence. It is the highest-stakes engine for brands with strong existing SEO.

Why four is the minimum: a vendor who only reports on one or two engines has a measurement gap that flatters their results. You need cross-engine coverage in your baseline so you can detect gains and losses wherever they actually occur.

How do you run a manual citation snapshot in an afternoon?

This is the part most guides skip. They tell you to track citations without giving you a process that costs less than a week to set up. Here is one that actually works.

Step 1: Build your query list. Start with 10 to 15 queries your customers actually ask. Good sources are your sales call recordings, your FAQ page, your competitors' FAQ pages, and Reddit threads that surface when you type your product category into Google. Use informational and comparison queries, not branded ones. Searching for your own name tells you almost nothing about competitive citation position.

Step 2: Open fresh sessions on each engine. Use incognito mode or clear your history. Run each query on ChatGPT, Perplexity, Claude, and Gemini in turn. On Perplexity, confirm web search is enabled. On ChatGPT, enable browsing for any queries that require current information.

Step 3: Record five things for each query on each engine.

• Do you appear at all?
• What is your approximate position or prominence if you do?
• What is the sentiment (positive, neutral, or negative)?
• Are you mentioned or directly recommended?
• Which competitors appear in the same response?

Step 4: Time-stamp everything. The date and time matter because citation behavior shifts. Your baseline is only useful if you can compare it against a later snapshot run under the same conditions.

Step 5: Repeat the same query set in 30 days. If you have changed nothing on your site and the numbers moved, you have measured natural market drift. That is important context for any vendor conversation. It also reveals how much of the variation you would otherwise be paying someone to explain.

The whole process takes three to four hours the first time and 90 minutes after that. The code example below gives you a ready-made tracker you can drop into a spreadsheet immediately.

What should your snapshot actually measure?

A citation rate is the percentage of your test queries where you appear in the engine's response.

That is the headline number. But there are four other dimensions that matter just as much for vendor accountability.

Mention versus recommendation. There is a real difference between appearing in a list of options and being named as the recommended choice. Research from the Content Marketing Institute shows that only 20% of AI-generated brand mentions include a direct recommendation, even though 31% are positive. A vendor who improves your mention rate without improving your recommendation rate has done half the job. Your baseline should track both separately.

Sentiment. Positive, neutral, and negative are the three buckets. Neutral is the most common. Negative is the one you have to watch, because if an AI engine describes your product in unflattering terms alongside a competitor, that shapes purchase intent in ways that never surface in your traffic data.

Competitor density. How often do your main competitors appear in the same responses as your query set? This tells you whether you are losing ground in a crowded citation space or competing for queries where you have a realistic chance to stand out. If five competitors appear in 80% of your test queries and you appear in 20%, the baseline tells you what you are up against before you brief anyone.

Cross-engine consistency. Are you appearing on all four engines for the same queries, or only on one? A brand that shows up consistently across ChatGPT, Perplexity, Claude, and Gemini for the same informational query is structurally stronger than one that only appears on Perplexity. Vendors who track only one engine can show impressive lift while the others deteriorate quietly.

These four dimensions together give you an honest picture: complete enough to write a vendor brief that goes beyond "more citations, please," and specific enough to argue with a before-and-after slide.

How does AEO Site Rank Scoring give you a structured baseline?

The manual process above works. It is also tedious to do consistently and hard to compare across time if different people run the snapshots. AEO Rank is the structured version of the same logic.

AEO Rank is a measurable score reflecting how well your content is formatted to earn AI citations. It evaluates the criteria engines actually use to decide what to include in a response: question-format headings that match how queries are phrased, fact density that gives engines specific claims to extract, FAQ coverage that addresses the questions your customers actually type, comparison tables that make information extractable, and entity authority that tells engines who you are and what you do.

When we run an AEO Rank assessment for a new client, we typically see initial scores ranging from 28 to 55, depending on how much structured content already exists. Clients who have invested in traditional blog content but not AEO-specific formatting tend to start around 40 to 48. After a 90-day structured content program with consistent implementation, the typical range reaches 62 to 74.

The reason this number matters for vendor accountability is simple: it is independently measurable. You can run an AEO Rank assessment before engaging anyone and re-run it after. If a vendor promises to improve your citation rate but cannot show you a change in the underlying criteria that drive citations, the improvement is statistical noise. Citation behavior is too volatile to treat any single snapshot as proof of causation. AEO Rank is the leading indicator that distinguishes structural improvement from market drift.

This is different from, and complementary to, the manual snapshot. The manual snapshot tells you where you currently appear in live AI responses. AEO Rank tells you why you do or do not appear, and what specifically needs to change. Together, they give you both the outcome measure and the leading indicator that predicts future citations.

What goes in your vendor brief once you have your numbers?

A vendor brief written from a real baseline is a fundamentally different document from one written from anxiety. Here is what to include, and why each element matters.

Lead with your query list. These are the specific queries you tested. The vendor now knows the terrain they are being hired to optimize for. This also prevents the common pattern where a vendor substitutes their own query set, runs better numbers on it, and reports improvement on queries that were never your actual competitive battleground.

Specify all four engines. ChatGPT, Perplexity, Claude, and Gemini. Require that reporting covers all of them. Any vendor who defaults to one or two should explain specifically why the others do not apply to your case, not simply skip them. If they cannot articulate why Perplexity is irrelevant to your audience, that is an answer too.

State your baseline metrics. Your citation rate on each engine as of your snapshot date. Your sentiment breakdown. How often you are recommended versus merely mentioned. These are the numbers they are being hired to move.

Require re-runs at 30, 60, and 90 days using your original query list. Natural query drift is real, but switching the query list mid-engagement is one of the most common ways to manufacture apparent improvement. Your list stays fixed unless you agree in writing to change it.

Finally, ask the vetting question that actually separates real AEO work from SEO rebranding. As one practitioner in a marketing forum put it: "Ask them which models actually cite you, for which prompts, and what the source was. If they can't answer that, it's just SEO with new branding." An agency that cannot answer specifically, for your niche, for your actual queries, is not ready to be accountable to your baseline.

Any citation improvement should come with an explanation of what changed on the content side. "We published three structured Q&A pieces targeting these specific queries, and here is the citation rate change we observed" is an accountable claim. "Citations are up 40%" is not.

Drop this into a spreadsheet as your citation snapshot tracker. One row per query per engine, one re-run at each 30-day interval.

Query | Engine     | Date       | Appears | Position | Sentiment | Type        | Competitors
------+------------+------------+---------+----------+-----------+-------------+---------------------------
Q1    | ChatGPT    | 2026-09-09 | Yes     | 2 of 4   | Positive  | Mentioned   | BrandA, BrandB
Q1    | Perplexity | 2026-09-09 | No      | -        | -         | -           | BrandA, BrandC, BrandD
Q1    | Claude     | 2026-09-09 | Yes     | 1 of 3   | Neutral   | Recommended | BrandB
Q1    | Gemini     | 2026-09-09 | No      | -        | -         | -           | BrandA, BrandB, BrandC
Q2    | ChatGPT    | 2026-09-09 | No      | -        | -         | -           | BrandC, BrandD

Citation rate per engine = rows where Appears = Yes divided by total rows for that engine. Track this at baseline, 30, 60, and 90 days using the same query list each time.

What will matter most for AI citation benchmarking in the next 12 to 24 months?

The measurement landscape for AI citations is, right now, genuinely immature. Most AI assistants, including Perplexity, Copilot, Gemini, and ChatGPT paid tiers, do not report citation or mention data back to brands through their own analytics. This forces every team doing serious citation tracking to rely on manual snapshots, third-party tools, or API queries, none of which provide the kind of native, authoritative data that Google Search Console provides for traditional search.

In the next year or two, I expect this gap to narrow. Third-party citation tracking tools are proliferating, and the category will get more capable and more standardized. But that standardization has not arrived yet, which is exactly why a manual baseline taken today remains valuable: it is yours, it is timestamped, and it does not depend on any vendor's interpretation of what their tool is measuring.

The second thing to watch is citation concentration. Research from Content Marketing Institute shows that three publishers already account for nearly a third of all news citations in Google AI Overviews, and the top ten capture about 80%. That pattern of concentration is likely to deepen, not reverse. The practical implication for benchmarking: your query-level citation rate matters more than your overall "visibility score," because the queries where you have a real chance of appearing are narrower than the full landscape suggests.

Finally: AI search platforms still drive well under 1% of referral traffic despite 20%+ monthly usage growth. That will change, but it has not changed yet. A baseline taken today captures a market that is still forming, which means the lift from early, structured investment in citation-worthy content will be disproportionate to the effort. The brands that benchmark now and act on those numbers will have a documented head start when the traffic contribution catches up to the usage growth.

The vendor conversation is genuinely worth having. There are agencies doing real AEO work, and the discipline matters more as AI search becomes a primary discovery channel for more categories. The point of this process is not to make you skeptical of everyone you talk to. The point is to arrive with a documented starting point.

A citation baseline taken this week, before any agency call, changes what that conversation looks like. It shifts from "trust our methodology" to "here is where you started, here is what we moved, here is why." That is what an accountable engagement looks like. The process described here takes an afternoon and protects whatever budget you commit after it. That seems like a reasonable use of the afternoon before you start spending.

Want to see where your site currently scores before briefing any vendor? The AEO Rank assessment gives you a breakdown by citation criterion in about 10 minutes, including which specific elements are holding your content back from AI engines. It is the structured baseline that complements the manual snapshot process described here.