What is MistralAI-Training? AI crawler guide
MistralAI-Training is a crawler or fetcher associated with Mistral AI. See source-graded user-agent, robots.txt, verification, and observation guidance.
What is MistralAI-Training?
MistralAI-Training is a documented Mistral AI crawler or fetcher. Mistral crawler for content that may be used to train its models, kept separate from its search index crawler.
Evidence status
| Field | Value |
|---|---|
| Evidence | Officially documented |
| Lifecycle | Active |
| Purpose | training |
| robots.txt posture | honors |
| Source checked | 2026-08-11 |
Documented user-agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)
robots.txt allow example
User-agent: MistralAI-Training Allow: /
robots.txt block example
User-agent: MistralAI-Training Disallow: /
What the rule can and cannot do
Robots.txt expresses an access policy to compliant automated crawlers. It does not authenticate the sender, remove content already collected, or guarantee that a model will use or not use content.
How to verify a request
- Match the complete documented user-agent where one exists. A match is only a clue.
- Look for operator-published IP ranges, reverse DNS, or signed-request guidance. None is attached to this record.
- Keep the observed request, operator documentation, and any inference as separate fields.
JavaScript behavior
The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.
Related bots
- GPTBot: Also tracked as a training crawler.
- KimiBot: Also tracked as a training crawler.
- Meta-ExternalAgent: Also tracked as a training crawler.
- Bytespider: Also tracked as a training crawler.
- Applebot-Extended: Also tracked as a training crawler.
- CCBot: Also tracked as a training crawler.
- AI2Bot: Also tracked as a training crawler.
- LAIONDownloader: Also tracked as a training crawler.
- ClaudeBot: Also tracked as a training crawler.
- AI Training Opt-Out: MistralAI-Training is a training crawler tied to this policy decision.
- Robots.txt: Robots.txt is the control file used to allow or block MistralAI-Training.
Frequently Asked Questions
What is MistralAI-Training?
MistralAI-Training is a officially documented crawler or fetcher record associated with Mistral AI.
What user-agent does MistralAI-Training use?
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots). Check the evidence status before attributing a matching request.
Can MistralAI-Training be blocked in robots.txt?
The record identifies MistralAI-Training as the token to review. Robots.txt is a request policy, not proof of model use or non-use.
How can I verify a MistralAI-Training request?
Treat the user-agent as a clue and look for operator-published IP, reverse-DNS, or signature guidance.
Data & Sources
- Mistral AI documentation - Primary source for MistralAI-Training crawler details.