Skip to content

See where you stand

Change it

Works withWordPressShopifyWebflowGitHubGoogleSlackAll integrations
FixesFixes now ship to WordPress, Shopify, Webflow and GitHub

By team

By goal

Done for you

Not sure where to start? Take a guided tour.Book a demo
Customer storyHow the voice AI company Futuro grew its traffic3×AI traffic in 60 days

Learn

Data and research

FreeAI Site GraderAI Query Scannerllms.txt GeneratorAll free tools
Open dataWhere AI sends people, across more than 6,000 sites

Allen Institute for AITraining crawler

Ai2Bot-Dolma

Ai2Bot-Dolma is an AI2 crawler token associated with Dolma/open language model dataset collection.

Training only. It does not decide whether you appear in answers.

Get the robots.txt ruleAllen Institute for AI documentation
Is Ai2Bot-Dolma allowed on your site?2 Allen Institute for AI bots
  • AI2BotTraining
    Not checked
  • Ai2Bot-DolmaTraining
    Not checked

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
Ai2Bot-Dolma
Follows robots.txt
Yes, documented
How to verify it
Not published
Seen on
Not measured
Last checked
11 June 2026

Should you block Ai2Bot-Dolma?

Only if you want your pages kept out of training data. Blocking it limits AI2 Dolma-related training data collection from your site.

What blocking each Allen Institute for AI bot does
Allen Institute for AI botJobIf you block it
AI2BotTrainingBlocking it keeps your content out of AI2’s crawler path for open model training data.
Ai2Bot-DolmaThis pageTrainingBlocking it limits AI2 Dolma-related training data collection from your site.
robots.txt
User-agent: Ai2Bot-Dolma
Disallow: /

Asks Ai2Bot-Dolma not to crawl any page. Other Allen Institute for AI bots are unaffected. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

Ai2Bot-Dolma collects pages for model training. Training inclusion is not the same as being cited, so measure where AI answers actually cite your site before drawing conclusions from crawl logs.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

User-agentsource
Ai2Bot-Dolma

Version numbers change. Match the highlighted name, not the whole string.

  1. 1

    Match the name

    Search your server or CDN log for Ai2Bot-Dolma, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the source

    Allen Institute for AI publishes no IP ranges, reverse DNS or signatures for Ai2Bot-Dolma in the sources here, so it cannot be verified. Treat matches as unconfirmed.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

Questions, answered.

Ai2Bot-Dolma is an AI2 crawler token associated with Dolma/open language model dataset collection.

Sources.

Officially documented. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Allen Institute for AI crawler documentation

    Officially documented · checked 11 June 2026

    allenai.org/crawler

First verified 11 June 2026. Last source check 11 June 2026.

All AI crawlers

See which AI crawlers read your site.

Trakkr shows which bots, Ai2Bot-Dolma included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.