Skip to content

ParallelAI search crawler

ShapBot

ShapBot is a Parallel crawler for discovering and indexing websites for Parallel web APIs.

Needed to be found in its search index.

Is ShapBot allowed on your site?
  • ShapBotSearch
    Not checked

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
ShapBot
Follows robots.txt
Yes, documented
How to verify it
Published IP ranges
Seen on
Not measured
Last checked
8 October 2026

Should you block ShapBot?

Not if you want to be found. Blocking it can prevent Parallel-powered applications from finding your pages through their crawler.

robots.txt
User-agent: ShapBot
Disallow: /

Asks ShapBot not to crawl any page. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

Whether to allow ShapBot is a policy call. Either way, check which AI platforms actually send you human visitors before assuming crawl volume equals value.

Also seen under Parallel’s name, but not in its current documentation: Shap-User. Rules naming them control no documented Parallel crawler.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent. Search your own logs for ShapBot.

User-agentsource
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0

Version numbers change. Match the highlighted name, not the whole string.

  1. 1

    Match the name

    Search your server or CDN log for ShapBot, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the published IP ranges

    Compare the request’s source with the list Parallel publishes. Anything outside it is not Parallel. docs.parallel.ai/resources/shapbot.json

Is this really ShapBot?

Published addresses

Paste an address that claims to be ShapBot. It is checked against Parallel’s published list. Nothing is stored.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

Questions, answered.

ShapBot is a Parallel crawler for discovering and indexing websites for Parallel web APIs.

Sources.

Officially documented. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Parallel crawler documentation

    Officially documented · checked 8 October 2026

    docs.parallel.ai/resources/crawler

First verified 18 August 2026. Last source check 8 October 2026.

See which AI crawlers read your site.

Trakkr shows which bots, ShapBot included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.