Skip to content

See where you stand

Change it

Works withWordPressShopifyWebflowGitHubGoogleSlackAll integrations
FixesFixes now ship to WordPress, Shopify, Webflow and GitHub

By team

By goal

Done for you

Not sure where to start? Take a guided tour.Book a demo
Customer storyHow the voice AI company Futuro grew its traffic3×AI traffic in 60 days

Learn

Data and research

FreeAI Site GraderAI Query Scannerllms.txt GeneratorAll free tools
Open dataWhere AI sends people, across more than 6,000 sites

xAITraining crawler

GrokBot

GrokBot is an xAI crawler token listed by public crawler directories for Grok-related crawling.

No current xAI operator page was found for this crawler name. Treat the string as reported until xAI publishes a crawler reference.

Get the robots.txt ruleRecord source
Is GrokBot allowed on your site?
  • GrokBotTraining
    Not checked

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
GrokBot
Follows robots.txt
Not documented
How to verify it
Not published
Last checked
11 August 2026

Should you block GrokBot?

You can, but it may not listen. xAI has not documented GrokBot, so treat any rule as a request. Use it for robots policy only if you see the token in logs. The crawler Trakkr actually observes for xAI is xAI-SearchBot.

About robots.txtxAI has not documented whether GrokBot follows robots.txt, so a rule is a request, not a guarantee.

robots.txt
User-agent: GrokBot
Disallow: /

Asks GrokBot not to crawl any page. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

Allowing GrokBot creates the possibility of retrieval. To find out whether Grok actually cites or recommends you, track your Grok mentions over time.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

Reported user-agentsource
GrokBot

This string comes from a public crawler registry or observed naming, not current operator documentation.

  1. 1

    Match the name

    Search your server or CDN log for GrokBot, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the source

    xAI publishes no IP ranges, reverse DNS or signatures for GrokBot in the sources here, so it cannot be verified. Treat matches as unconfirmed.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

xAI publishes no crawler documentation. Across Trakkr’s monitored sites this token is rare, while xAI-SearchBot appears steadily, so treat xAI-SearchBot as the live one.

How active is GrokBot?

Measured across the sites connected to Trakkr, 27 July 2026 to 25 October 2026.

37%

of connected sites saw GrokBot in the four weeks to 25 October 2026. That is 38 of 104.

100%75%50%25%36%
GrokBot visited between 17% and 36% of connected sites each week from 27 July 2026 to 25 October 2026.

Share of connected sites it visited each week

Rank by reach
13 of 26
Typical site, per week
17 requests
Sites reached, 13 weeks
49 of 135

Most widespread AI crawlers

Share of connected sites each one visited, last four weeks.

  1. 1OAI-SearchBot84%
  2. 2ClaudeBot84%
  3. 3GPTBot67%
  4. 4Amazonbot61%
  5. 5ChatGPT-User56%
  6. 6PerplexityBot56%
  7. 7Applebot51%
  8. 13GrokBot37%
All 26 measured crawlers
How this is measured

Finalized daily crawler summaries from sites connected to Trakkr, grouped by the crawler named in each request. Trakkr’s own site is excluded. A site counts as reached in a week when it logged at least one request from GrokBot. The typical figure is the median weekly requests among the sites it reached.

  • This is a sample of connected sites, not the whole web.
  • A matching user-agent does not prove the named operator sent the request.
  • Requests are not unique pages, training use or citations.
  • Crawlers seen on fewer than 10 sites are not shown. Classic search crawlers such as Googlebot are not collected on every site, so they are left out.

Questions, answered.

GrokBot is an xAI crawler token listed by public crawler directories for Grok-related crawling. This record has no current xAI source, so treat a matching request as unverified.

Sources.

Reported, not operator verified. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Reported crawler reference

    Reported, not operator verified · checked 11 August 2026

    crawlercheck.com/directory/ai-bots/grokbot

Last source check 11 August 2026. Activity measured to 25 October 2026.

All AI crawlers

See which AI crawlers read your site.

Trakkr shows which bots, GrokBot included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.