Skip to content

See where you stand

Change it

Works withWordPressShopifyWebflowGitHubGoogleSlackAll integrations
FixesFixes now ship to WordPress, Shopify, Webflow and GitHub

By team

By goal

Done for you

Not sure where to start? Take a guided tour.Book a demo
Customer storyHow the voice AI company Futuro grew its traffic3×AI traffic in 60 days

Learn

Data and research

FreeAI Site GraderAI Query Scannerllms.txt GeneratorAll free tools
Open dataWhere AI sends people, across more than 6,000 sites

GoogleControl token

Google-Extended

Google-Extended is a robots.txt control token from Google, not a fetching crawler user-agent. It controls eligible use of Google-crawled content for Gemini training and grounding.

It covers Gemini, not Google Search.

Get the robots.txt ruleGoogle documentation
Is Google-Extended allowed on your site?4 Google bots

Reads your live robots.txt and applies the same rules these crawlers use. Nothing is stored.

robots.txt token
Google-Extended
Follows robots.txt
Yes, documented
How to verify it
Not published
Seen on
Never fetches pages
Last checked
18 August 2026

Should you block Google-Extended?

Only if you want your pages out of Gemini. It covers Gemini training and grounding, while Googlebot keeps your pages in Google Search and its AI features.

What blocking each Google bot does
Google botJobIf you block it
Google-ExtendedThis pageControl tokenDisallowing it limits future Gemini training and grounding uses covered by the token. Google says it does not affect Search inclusion or ranking.
GooglebotSearchBlocking Googlebot can remove pages from Google Search and eligibility for Google AI features that depend on Search indexing.
Google-AgentUser fetchBlocking it can prevent a Google agent from retrieving a page while completing a user-directed task. It is separate from Google Search crawling.
Google-GeminiNotebookUser fetchA hit usually means a person added your page as a source, not that Google is crawling your site broadly.
Google-CloudVertexBotOtherA hit usually relates to a configured Vertex AI workflow rather than broad public search crawling.
GoogleOtherOtherBlocking it may affect Google product-specific crawling but is separate from primary Search indexing policy.
GoogleOther-ImageOtherBlocking it can limit image-oriented Google product crawls without targeting regular Googlebot directly.
GoogleOther-VideoOtherBlocking it can limit video-oriented Google product crawls without targeting regular Googlebot directly.

From Google’s documentationGoogle says Google-Extended does not affect inclusion or ranking in Google Search. It controls Gemini training and grounding.

robots.txt
User-agent: Google-Extended
Disallow: /

Opts out of the uses Google-Extended covers. Crawling for search carries on. Add it to the robots.txt file at the root of your site, above any wider rules.

Ignored robots.txt?

To see every AI control on your site at once, run the free site audit, then compare its robots.txt findings with the policy you mean to publish.

Google-Extended controls AI training use, not whether Google Search can index you. If the practical question is whether Google’s assistant recommends your brand, monitor brand mentions in Gemini separately.

To see why Google-Extended access is worth checking rather than assuming, read one site’s before and after, from blocked crawlers to first-place citations.

Also seen under Google’s name, but not in its current documentation: GoogleAgent-Mariner, Gemini-Deep-Research, Google-NotebookLM, Google-Gemini-CLI, Google-Firebase. Rules naming them control no documented Google crawler.

Spot it in your logs.

Match the name, then check where the request came from. Anyone can copy a user-agent.

It never appears in your logs

Google-Extended is a robots.txt token only. Google’s regular crawler fetches the pages, and this token decides how they may be used.

  1. 1

    Match the name

    Search your server or CDN log for Google-Extended, case-insensitive. A match is a clue, not proof.

  2. 2

    Check the source

    Google publishes no IP ranges, reverse DNS or signatures for Google-Extended in the sources here, so it cannot be verified. Treat matches as unconfirmed.

Serve the content in HTML

The cited operator material does not verify JavaScript rendering. Serve useful HTML before client-side JavaScript where possible.

Google-Extended has no separate HTTP user-agent string and does not fetch pages, so it cannot have its own crawl telemetry.

Questions, answered.

Google-Extended is a robots.txt control token from Google, not a fetching crawler user-agent. It controls eligible use of Google-crawled content for Gemini training and grounding.

Sources.

Officially documented. Operator facts and Trakkr’s measurements keep separate dates.

  1. [1]
    Google crawler documentation

    Officially documented · checked 18 August 2026

    developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended

First verified 18 August 2026. Last source check 18 August 2026.

Changes

Google refreshed its crawler referenceThe current reference separates common crawlers, special-case crawlers, user-triggered fetchers, and product control tokens.
All AI crawlers

See which AI crawlers read your site.

Trakkr shows which bots, Google-Extended included, visit which pages each day, and whether the answers they feed mention you.

14-day free trial. Cancel anytime.