Engines · Grok
Visibility in Grok: Web and X search, what is known and what is not
Grok can compile answers from the web and from posts on X. But unlike OpenAI or Anthropic, xAI does not publish documentation describing its crawlers and how to manage them. This page separates what is known from what is not.
xAI’s API documentation lists web search and X search as built-in, server-side tools for Grok models. However, xAI does not publish an official crawler list that site owners can manage with robots.txt. So for Grok, rather than making bot decisions, we measure visibility directly.
What is known?
xAI’s API documentation lists Web Search and X Search as built-in tools managed by xAI that run automaticallySource 1: Tools overview (xAI API). So Grok can compile an answer from both web pages and posts on X.
That means your official X account can be a source too: its name, bio and link should match the information on your site.
What is not known?
- We found no official crawler name in xAI’s documentation that site owners can target in robots.txt (checked 26 September 2026).
- Bot names attributed to Grok circulate in third-party lists; since they cannot be verified against an official source, we do not recommend robots.txt rules based on them.
- How Grok chooses its sources is not explained.
How do we measure Grok?
The question set is asked the same way every month, each question twice. We record whether the brand is mentioned, which sources are shown (web pages or X posts) and whether the information is correct. If xAI publishes official crawler documentation, we will update this page with the date.
Frequently asked questions
01Can I block Grok with robots.txt?
We found no official crawler name in xAI’s documentation to target. The names in third-party lists are unverified, so we cannot recommend a rule based on them.
02Does our X account affect Grok’s answers?
xAI lists X search as a built-in tool for GrokSource 1: Tools overview (xAI API), so posts on X can be sources in answers. Keeping your official account consistent with your site matters.
03Can you see Grok’s sources?
We record the sources shown in answers during measurement. How sources are selected is not explained by xAI.
Sources
- [1]Tools overview (xAI API)xAI · accessed: 26 September 2026
How to cite this page
Kaynaq. (26 September 2026). Visibility in Grok: Web and X search, what is known and what is not. https://kaynaq.pages.dev/en/ai-engines/grok
Updates and corrections
No corrections on this page yet. If you spot an error, write to us; we publish every fix here with its date.