Skip to content

AnthropicLive fetcher

Claude-Code

Claude-Code is a Claude Code related agent token seen in crawler/user-agent lists. This record has no current Anthropic source, so treat a matching request as unverified.

Reads a page when someone asks Claude about it.

Is Claude-Code allowed on your site?4 Anthropic bots

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
Claude-Code
Follows robots.txt
Not documented
How to verify it
Not published
Last checked
11 June 2026

Should you block Claude-Code?

There is little to gain. Anthropic does not document Claude-Code, so a rule naming it controls none of its documented crawlers. Write rules for ClaudeBot, Claude-SearchBot and Claude-User instead.

What blocking each Anthropic bot does
Anthropic botJobIf you block it
ClaudeBotTrainingDisallowing ClaudeBot expresses a training-data opt-out for future compliant requests. A crawler log cannot confirm whether content entered a training dataset.
Claude-SearchBotSearchDisallowing it can reduce Claude search discovery. Allowing it does not guarantee indexing, ranking, citation, or referral traffic.
Claude-CodeThis pageUser fetchA hit is more likely developer-tool retrieval than broad crawling; validate the request source before creating policy.
Claude-UserUser fetchDisallowing it asks the documented fetcher not to retrieve covered paths. A matching request does not prove a page was cited in a Claude answer.

About robots.txtAnthropic has not documented whether Claude-Code follows robots.txt, so a rule is a request, not a guarantee.

robots.txt
User-agent: Claude-Code
Disallow: /

Asks Claude-Code not to crawl any page. Other Anthropic bots are unaffected. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

Claude-Code fetches pages for a developer tool, so its visits rarely map to buyer behavior. For the demand side, see how much human traffic AI platforms actually send you.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

Reported user-agentsource
Claude-Code

This string comes from a public crawler registry or observed naming, not current operator documentation.

  1. 1

    Match the name

    Search your server or CDN log for Claude-Code, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the source

    Anthropic publishes no IP ranges, reverse DNS or signatures for Claude-Code in the sources here, so it cannot be verified. Treat matches as unconfirmed.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

How active is Claude-Code?

Measured across the sites connected to Trakkr, 27 July 2026 to 25 October 2026.

39%

of connected sites saw Claude-Code in the four weeks to 25 October 2026. That is 40 of 104.

100%75%50%25%35%
Claude-Code visited between 20% and 35% of connected sites each week from 27 July 2026 to 25 October 2026.

Share of connected sites it visited each week

Rank by reach
11 of 26
Typical site, per week
24 requests
Sites reached, 13 weeks
45 of 135

Most widespread AI crawlers

Share of connected sites each one visited, last four weeks.

  1. 1OAI-SearchBot84%
  2. 2ClaudeBot84%
  3. 3GPTBot67%
  4. 4Amazonbot61%
  5. 5ChatGPT-User56%
  6. 6PerplexityBot56%
  7. 7Applebot51%
  8. 11Claude-Code39%
All 26 measured crawlers
How this is measured

Finalized daily crawler summaries from sites connected to Trakkr, grouped by the crawler named in each request. Trakkr’s own site is excluded. A site counts as reached in a week when it logged at least one request from Claude-Code. The typical figure is the median weekly requests among the sites it reached.

  • This is a sample of connected sites, not the whole web.
  • A matching user-agent does not prove the named operator sent the request.
  • Requests are not unique pages, training use or citations.
  • Crawlers seen on fewer than 10 sites are not shown. Classic search crawlers such as Googlebot are not collected on every site, so they are left out.

Questions, answered.

Claude-Code is a Claude Code related agent token seen in crawler/user-agent lists. This record has no current Anthropic source, so treat a matching request as unverified.

Sources.

Reported, not operator verified. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Reported crawler reference

    Reported, not operator verified · checked 11 June 2026

    github.com/ai-robots-txt/ai.robots.txt/blob/main/table-of-bot-metrics.md

Last source check 11 June 2026. Activity measured to 25 October 2026.

See which AI crawlers read your site.

Trakkr shows which bots, Claude-Code included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.