ParallelAI search crawler
ShapBot
ShapBot is a Parallel crawler for discovering and indexing websites for Parallel web APIs.
Needed to be found in its search index.
- ShapBotSearchNot checked
Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.
- robots.txt token
ShapBot- Follows robots.txt
- Yes, documented
- How to verify it
- Published IP ranges
- Seen on
- Not measured
- Last checked
- 8 October 2026
Should you block ShapBot?
Not if you want to be found. Blocking it can prevent Parallel-powered applications from finding your pages through their crawler.
User-agent: ShapBot
Disallow: /Asks ShapBot not to crawl any page. Add it to the robots.txt file at the root of your site, above any wider rules.
Whether to allow ShapBot is a policy call. Either way, check which AI platforms actually send you human visitors before assuming crawl volume equals value.
Also seen under Parallel’s name, but not in its current documentation: Shap-User. Rules naming them control no documented Parallel crawler.
Spot it in your logs.
Match the name, then check where the request came from. Anyone can copy a user-agent. Search your own logs for ShapBot.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0Version numbers change. Match the highlighted name, not the whole string.
- 1
Match the name
Search your server or CDN log for
ShapBot, case-insensitive. A match is a clue, not proof. - 2
Check the published IP ranges
Compare the request’s source with the list Parallel publishes. Anything outside it is not Parallel. docs.parallel.ai/resources/shapbot.json
Is this really ShapBot?
Published addressesPaste an address that claims to be ShapBot. It is checked against Parallel’s published list. Nothing is stored.
Serve the content in HTML
The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.
Questions, answered.
ShapBot is a Parallel crawler for discovering and indexing websites for Parallel web APIs.
Sources.
Officially documented. Operator facts and Trakkr’s measurements keep separate dates.
- [1]Parallel crawler documentation
Officially documented · checked 8 October 2026
docs.parallel.ai/resources/crawler
First verified 18 August 2026. Last source check 8 October 2026.
See which AI crawlers read your site.
Trakkr shows which bots, ShapBot included, visit which pages each day, and whether the answers they feed mention you.
14-day free trial. Cancel anytime.