Blog

Ranking well on Google but rarely in AI answers? Six causes and how to diagnose them

By Dawn, Founder of CitedAsia · Published 8 November 2026

Short answer: Ranking well on Google does not guarantee AI tools will name you, because AI tools read pages differently and want proof from other sites. The usual reasons are: AI crawlers such as OAI-SearchBot are blocked, the page text only appears after JavaScript runs, your paragraphs do not answer a question directly, your business details are unclear or inconsistent, the content is out of date, or no trusted third-party site mentions you. Check those six things first, then test real buyer questions in each AI tool.

Why can you rank on Google but not appear in AI answers?

Google ranks pages; AI tools pick a few businesses and quote facts they can check. A page can rank because of its links and history, yet still be hard for an AI tool to read, quote or trust. AI tools also look beyond your website and often name businesses that other sites mention.

What are the most common causes?

1. AI crawlers are blocked

Each AI company uses its own crawlers, and your robots.txt, firewall or CDN may block them without you knowing. OpenAI’s documentation says OAI-SearchBot is the crawler that lets websites appear in ChatGPT search answers, and blocking it keeps a site out of those answers. GPTBot, by contrast, is for model training, and the two settings are independent. Check for Perplexity’s crawler, PerplexityBot, too.

2. The text only appears after JavaScript runs

Google can render JavaScript, so a page built that way can still rank. Many AI crawlers read the raw HTML instead. If your main text is loaded by scripts, they may see an almost empty page. View the page source and search for a sentence you can see on screen; if it is missing, the text is rendered in the browser.

3. Paragraphs cannot be quoted on their own

AI answers are built from short passages. If the answer to a buyer’s question is spread across a long introduction, or never stated as a plain fact, there is nothing clean to quote. Put the direct answer, with numbers, in the first one to three sentences under each heading.

4. Your business is not a clear entity

AI tools need to be sure which business they are talking about. Different names, addresses or phone numbers across your website, Google Business Profile and directories make that harder. Structured data for your organisation, with links to your official profiles, helps them match the facts to you.

5. The content is out of date

Old prices, past dates or services you no longer offer give AI tools a reason to prefer a fresher source. Keep key pages current and show when they were last updated.

6. No third-party proof

AI answers often lean on directories, review sites, news and “best of” articles. If those sources name your competitors and not you, ranking well on your own site is often not enough.

How do you diagnose the gap yourself?

CheckHow to test it
AI crawler accessOpen yoursite.com/robots.txt and look for blocks on OAI-SearchBot, PerplexityBot or all bots; check your firewall or CDN bot settings
Text without JavaScriptView the page source and search for a visible sentence
Quotable answersRead the first paragraph under each heading on its own: does it answer the question?
Entity clarityCompare your name, address and phone across your site, Google Business Profile and directories; test your structured data
FreshnessCheck dates and prices on your key pages
Third-party proofAsk Perplexity or Google AI your buyer questions and look at the sources they show
The gap itselfCompare the pages that rank in Google Search Console with the pages AI tools cite for the same questions

Download the full diagnostic checklist (CSV, opens in Excel or Google Sheets), with 14 checks and space to record pass or fail.

What should you fix first?

  1. Crawler access and rendering, because nothing else matters if AI tools cannot read the page.
  2. Direct answers on your key service pages, with prices or ranges.
  3. Consistent business details and structured data.
  4. Listings and mentions on the sites AI cites for your category.

Then re-test the same buyer questions every month, because AI answers change over time.

When should you get an audit?

If the checklist does not show an obvious cause, or you need to know exactly which questions you are missing from, our AI visibility audit tests 20 real buyer questions on ChatGPT, Perplexity, Gemini and Google AI, records whether you are named or only cited, checks crawler access, structured data and page structure, and gives you a written 30-day plan. It costs USD 690.

Frequently asked questions

Does blocking GPTBot remove me from ChatGPT answers?

Not by itself. According to OpenAI, GPTBot is used for model training and OAI-SearchBot for ChatGPT search, and each robots.txt setting is independent. To appear in ChatGPT search answers, OAI-SearchBot must be allowed.

If I rank first on Google, will Google AI Overviews use my page?

Not always. Google AI Overviews draw on Google’s index, so ranking helps, but the overview may quote a page with a clearer direct answer or a source that mentions several businesses.

How long until AI tools pick up my fixes?

Crawler and page fixes can be read within days or weeks, but AI answers change gradually. Steady results usually take 3 to 6 months, so test the same questions every month.

Can I do this without changing SEO agencies?

Yes. Most of these fixes sit alongside normal SEO work. See working alongside your SEO agency.

Updated November 2026 · Written by Dawn, Founder of CitedAsia · AI visibility audit · GEO vs SEO · Schema for AI search · Rankings up, no enquiries · Source: OpenAI, Overview of OpenAI crawlers

Is your business in the answer?

Free check of 5 customer questions on ChatGPT and Perplexity. Score in 30 seconds, full report within 24 hours (business days).