Skip to content

See where you stand

Change it

Works withWordPressShopifyWebflowGitHubGoogleSlackAll integrations
FixesFixes now ship to WordPress, Shopify, Webflow and GitHub

By team

By goal

Done for you

Not sure where to start? Take a guided tour.Book a demo
Customer storyHow the voice AI company Futuro grew its traffic3×AI traffic in 60 days

Learn

Data and research

FreeAI Site GraderAI Query Scannerllms.txt GeneratorAll free tools
Open dataWhere AI sends people, across more than 6,000 sites

Bright DataOther crawler

Brightbot

Brightbot is Bright Data’s declared crawler for collecting public web data for its own datasets.

Not tied to answers in an AI assistant.

Get the robots.txt ruleBright Data documentation
Is Brightbot allowed on your site?
  • BrightbotOther
    Not checked

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
Brightbot
Follows robots.txt
Not documented
How to verify it
Declared source subnet
Seen on
Not measured
Last checked
11 August 2026

Should you block Brightbot?

Blocking it stops the declared crawler only. Bright Data’s proxy products route customer traffic through residential addresses that do not identify themselves.

About robots.txtBright Data has not documented whether Brightbot follows robots.txt, so a rule is a request, not a guarantee.

robots.txt
User-agent: Brightbot
Disallow: /

Asks Brightbot not to crawl any page. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

User-agentsource
Brightbot 1.0

Version numbers change. Match the highlighted name, not the whole string.

  1. 1

    Match the name

    Search your server or CDN log for Brightbot, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the declared source subnet

    Bright Data declares the single subnet 82.97.199.0/24 for Brightbot. brightdata.com/brightbot

Is this really Brightbot?

Published addresses

Paste an address that claims to be Brightbot. It is checked against Bright Data’s published list. Nothing is stored.

Check any crawler’s address

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

Bright Data directs site owners to its own collectors.txt file rather than robots.txt, and reviews those rules before they take effect.

Questions, answered.

Brightbot is Bright Data's declared crawler for collecting public web data for its own datasets.

Sources.

Officially documented. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Bright Data crawler documentation

    Officially documented · checked 11 August 2026

    brightdata.com/brightbot

First verified 11 August 2026. Last source check 11 August 2026.

All AI crawlers

See which AI crawlers read your site.

Trakkr shows which bots, Brightbot included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.