What is Kagibot? AI crawler guide
Kagibot is a crawler or fetcher associated with Kagi. See source-graded user-agent, robots.txt, verification, and observation guidance.
What is Kagibot?
Kagibot is a documented Kagi crawler or fetcher. Kagi search crawler that indexes pages for its search index and the answers built on it.
Evidence status
| Field | Value |
|---|---|
| Evidence | Officially documented |
| Lifecycle | Active |
| Purpose | search |
| robots.txt posture | honors |
| Source checked | 2026-08-11 |
Documented user-agent
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)
robots.txt allow example
User-agent: Kagibot Allow: /
robots.txt block example
User-agent: Kagibot Disallow: /
What the rule can and cannot do
Robots.txt expresses an access policy to compliant automated crawlers. It does not authenticate the sender, remove content already collected, or guarantee that a model will use or not use content.
How to verify a request
- Match the complete documented user-agent where one exists. A match is only a clue.
- Use the operator-published check: Published IPs and reverse DNS.
- Keep the observed request, operator documentation, and any inference as separate fields.
JavaScript behavior
The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.
Related bots
- Kimi-SearchBot: Also tracked as a search crawler.
- Amzn-SearchBot: Also tracked as a search crawler.
- ExaSearchBot: Also tracked as a search crawler.
- OAI-SearchBot: Also tracked as a search crawler.
- Claude-SearchBot: Also tracked as a search crawler.
- PerplexityBot: Also tracked as a search crawler.
- YouBot: Also tracked as a search crawler.
- xAI-SearchBot: Also tracked as a search crawler.
- MistralAI-Index: Also tracked as a search crawler.
- Robots.txt: Robots.txt is the control file used to allow or block Kagibot.
- SearchGPT: Kagibot is a search crawler tied to AI answer visibility.
Frequently Asked Questions
What is Kagibot?
Kagibot is a officially documented crawler or fetcher record associated with Kagi.
What user-agent does Kagibot use?
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot). Check the evidence status before attributing a matching request.
Can Kagibot be blocked in robots.txt?
The record identifies Kagibot as the token to review. Robots.txt is a request policy, not proof of model use or non-use.
How can I verify a Kagibot request?
Start with the full user-agent, then use published ips and reverse dns from the operator. A user-agent match alone is not proof.
Data & Sources
- Kagi documentation - Primary source for Kagibot crawler details.
- Kagibot verification: Published IPs and reverse DNS - Kagi publishes its source IPs and its crawler resolves under kagibot.org.