2026-07-03
Why AI search can't find your app (and the 5 fixes that take an afternoon)
Someone asked ChatGPT for "the best tool to do X" today, and it recommended your competitor. Not because their product is better — because their site is legible to AI and yours isn't.
Here's the direct answer up front: AI search engines can't recommend your app if they can't crawl it, can't parse what it is, or never indexed it in the first place. Five fixes solve 90% of that, and none of them require an SEO agency.
1. Your robots.txt is blocking the exact bots you want
The bots that matter here are the search crawlers — OAI-SearchBot (ChatGPT search), PerplexityBot, Claude-SearchBot, Googlebot, and Bingbot. They all respect robots.txt, and a surprising number of templates and "block bots" plugins disallow them wholesale. If User-agent: * + Disallow: / is anywhere near your file, you've opted out of being findable entirely.
One distinction most audits miss: GPTBot, ClaudeBot, and Google-Extended are training bots. Blocking them is a legitimate content-policy choice that does not affect whether people or AI search can find you. Don't let a tool scare you into allowing them "for SEO" — that's not how any of this works.
Fix: explicitly allow the search crawlers (OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot, Bingbot). Decide separately, on policy grounds, what to do about training bots.
2. You don't have an llms.txt
llms.txt is a plain-text brief that sits at yoursite.com/llms.txt and tells AI models what your product is, who it's for, and what it costs — without making them parse your React hydration payload. Honest caveat: it's an experimental compatibility file. Perplexity, Claude, and coding agents read it; Google Search ignores it entirely. It takes ten minutes to write, so it's still worth having — just don't expect it to move your Google rankings, because it won't.
3. Zero schema markup
SoftwareApplication, Organization, and FAQPage JSON-LD blocks are how engines confirm what kind of thing your site is. FAQ schema is especially valuable because AI answers are literally question-shaped — you're handing them pre-formatted answers.
4. Bing has never heard of you
This is the one everyone misses: ChatGPT uses its own search crawler plus multiple providers including Bing — and Bing's index feeds other AI assistants too. You submitted your sitemap to Google Search Console two years ago and never thought about Bing once. If Bing has never indexed you, you're invisible to a whole slice of AI-assisted search. Go to Bing Webmaster Tools, import your site from GSC, and submit your sitemap. It takes eight minutes.
5. Your homepage buries the answer
AI engines quote answer capsules — 2–4 plain sentences that directly answer "what is this?" If your hero says "Supercharge your workflow ✨" and the actual explanation is four scrolls down, there's nothing quotable. Open with the answer; be clever afterwards.
We built AlphaWhale AI to do all five automatically: paste your URL, get a 0–100 GEO score, and download the generated llms.txt, JSON-LD, and robots fixes — plus your full launch kit and a 100-directory submission checklist. The free audit shows you exactly where you stand.