Model trainingYour call — not scored
Applebot-Extended
A control token, not a crawler. Disallow it to stay out of Apple model training while keeping Siri and Spotlight visibility.
- robots.txt token
Applebot-Extended- Operator
- Apple ↗
- Powers
- Apple foundation model training
- Honours robots.txt
- Yes, documentedDocumentation ↗
A control token, not a crawler: it is honoured in robots.txt but never sent as a user-agent, so it cannot be tested with a live request.
Allow it
User-agent: Applebot-Extended
Allow: /Block it
User-agent: Applebot-Extended
Disallow: /Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →
Apple
Check your own site
robots.txt is only half the answer: your CDN can refuse Applebot-Extended before it ever reads the file. A scan checks both.
Free, no account, about 5 seconds.