AI engines
AI engines
Each engine reaches web information differently: some with their own crawler, some through a search engine’s index, some without explaining how at all. These pages set out, for each engine, what the company’s own documentation says, what it does not say and how we measure it.
ChatGPTChatGPT visibility: OAI-SearchBot vs GPTBot vs ChatGPT-User, robots.txt decisions, utm_source=chatgpt.com and how we measure.
Gemini and AI OverviewsAI Overviews and AI Mode requirements, snippet controls, the Search generative AI setting, Google-Extended and Search Console reports.
PerplexityPerplexity visibility: PerplexityBot vs Perplexity-User, robots.txt, IP ranges for firewalls and how we measure.
CopilotCopilot visibility: the Bing Webmaster Tools AI Performance report, grounding queries, citation share and how we measure.
ClaudeClaude visibility: ClaudeBot vs Claude-SearchBot vs Claude-User, robots.txt decisions, Crawl-delay and how we measure.
GrokGrok visibility: xAI’s web and X search tools, the absence of an official crawler list and how we measure.
DeepSeekDeepSeek visibility: the Internet Search feature, the absence of official crawler documentation and how we measure.
Meta AIMeta AI visibility: Meta-WebIndexer vs Meta-ExternalAgent vs Meta-ExternalFetcher, robots.txt decisions and how we measure.
How should you read these pages?
Crawler names and controls come only from the companies’ own documentation and carry the date we checked them. Where a company has not explained something, we say so plainly rather than repeating guesses from third-party lists. Our readiness test shows whether your site is open to these bots.