Google-Extended: what it is and how to allow or block it
A robots.txt setting for Gemini training and grounding. It never visits your site and doesn’t affect Google Search.
Last checked 2026-10-08
- Company
- Used for
- Gemini model training and grounding
- Job
- Control setting, not a crawler
- Follows robots.txt
- Not a crawler
- Name in robots.txt
- Google-Extended
What Google-Extended does
Google-Extended is not a crawler. Google says it “doesn’t have a separate HTTP request user agent string.” Pages are still collected by Google’s normal crawlers, and this token tells Google how it may use them.
It covers two things: whether your pages may be used to train future Gemini models, and whether they may be used for grounding, meaning Google supplying content from its search index to Gemini while it answers.
Google states that it “does not impact a site’s inclusion in Google Search nor is it used as a ranking signal in Google Search.” It also does not control AI Overviews or AI Mode, which are part of Google Search.
Should you allow it?
A choice about Gemini specifically. Blocking it has no effect on Google Search. If your goal is to stay out of AI Overviews, this token won’t do it; see our guide on opting out of AI Overviews.
What blocking it changes: Your pages should not be used to train future Gemini models or to ground Gemini’s answers. Your Google Search listing, and your appearance in AI Overviews and AI Mode, stay as they are.
Using Google-Extended in robots.txt
Use the token in robots.txt like any other name. Google’s crawlers read it and apply it to how your pages are used.
To allow it
User-agent: Google-Extended Allow: /
To block it
User-agent: Google-Extended Disallow: /
robots.txt lets every bot in by default, so you only need the allow lines if another rule in your file would otherwise block it. Our robots.txt guide explains how rules for different bots combine.
Is there anything to verify?
There is nothing to verify, since no bot called Google-Extended ever visits. Visits come from Google’s normal crawlers.
Source: Google crawler documentation, checked 2026-10-08. Bots and their rules change often, so check the company’s own page before making a decision that matters.
What actually controls how Google’s AI features use your pages is covered in our AI Overviews opt-out guide.
Other Google bots
See which AI bots your site lets in
The free AI readiness check reads your robots.txt and reports which of the main AI crawlers are allowed or blocked, along with everything else that decides whether AI can understand your site.
Check your site free