Skip to content

CohereTraining crawler

cohere-training-data-crawler

cohere-training-data-crawler is a Cohere training-data crawler token reported for downloading web data for enterprise language models. This record has no current Cohere source, so treat a matching request as unverified.

Training only. It does not decide whether you appear in answers.

Is cohere-training-data-crawler allowed on your site?
  • cohere-training-data-crawlerTraining
    Not checked

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
cohere-training-data-crawler
Follows robots.txt
Not documented
How to verify it
Not published
Seen on
Not measured
Last checked
11 June 2026

Should you block cohere-training-data-crawler?

You can, but it may not listen. Cohere has not documented cohere-training-data-crawler, so treat any rule as a request. Blocking it expresses a training-data opt-out for Cohere-specific crawling.

About robots.txtCohere has not documented whether cohere-training-data-crawler follows robots.txt, so a rule is a request, not a guarantee.

robots.txt
User-agent: cohere-training-data-crawler
Disallow: /

Asks cohere-training-data-crawler not to crawl any page. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

cohere-training-data-crawler collects pages for model training. Training inclusion is not the same as being cited, so measure where AI answers actually cite your site before drawing conclusions from crawl logs.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

Reported user-agentsource
cohere-training-data-crawler

This string comes from a public crawler registry or observed naming, not current operator documentation.

  1. 1

    Match the name

    Search your server or CDN log for cohere-training-data-crawler, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the source

    Cohere publishes no IP ranges, reverse DNS or signatures for cohere-training-data-crawler in the sources here, so it cannot be verified. Treat matches as unconfirmed.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

Questions, answered.

cohere-training-data-crawler is a Cohere training-data crawler token reported for downloading web data for enterprise language models. This record has no current Cohere source, so treat a matching request as unverified.

Sources.

Reported, not operator verified. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Reported crawler reference

    Reported, not operator verified · checked 11 June 2026

    github.com/ai-robots-txt/ai.robots.txt/blob/main/table-of-bot-metrics.md

Last source check 11 June 2026.

See which AI crawlers read your site.

Trakkr shows which bots, cohere-training-data-crawler included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.