Skip to content
Crawlable
frSign in
AgentBlocking it costs you visibility

GoogleAgent-URLContext

Retrieves your page when a Gemini API caller passes its URL as context.

robots.txt token
GoogleAgent-URLContext
Operator
Google ↗
Powers
Gemini API URL context
Honours robots.txt
Not documented

Allow it

User-agent: GoogleAgent-URLContext
Allow: /

Block it

User-agent: GoogleAgent-URLContext
Disallow: /

Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →

User-Agent

Mozilla/5.0 (compatible; GoogleAgent-URLContext; +https://ai.google.dev) Crawlable/1.0; +https://crawlable.fr/probe

This is the string we send when probing. The Crawlable suffix identifies us in your logs.

Google

Check your own site

robots.txt is only half the answer: your CDN can refuse GoogleAgent-URLContext before it ever reads the file. A scan checks both.

Free, no account, about 5 seconds.