AI searchBlocking it costs you visibility
Amazonbot
Feeds Alexa and the Rufus shopping assistant. Matters for retail.
- robots.txt token
Amazonbot- Operator
- Amazon ↗
- Powers
- Alexa answers · Rufus shopping assistant
- Honours robots.txt
- Yes, documentedDocumentation ↗
Allow it
User-agent: Amazonbot
Allow: /Block it
User-agent: Amazonbot
Disallow: /Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →
User-Agent
Mozilla/5.0 (Linux; like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Crawlable/1.0; +https://crawlable.fr/probeThis is the string we send when probing. The Crawlable suffix identifies us in your logs.
Amazon
Check your own site
robots.txt is only half the answer: your CDN can refuse Amazonbot before it ever reads the file. A scan checks both.
Free, no account, about 5 seconds.