Skip to content
Crawlable
frSign in
Model trainingYour call — not scored

Meta-ExternalAgent

Collects content for Meta AI products and Llama training.

robots.txt token
meta-externalagent
FacebookBot
Operator
Meta ↗
Powers
Meta AI · Llama training
Honours robots.txt
Yes, documented

Allow it

User-agent: meta-externalagent
Allow: /

Block it

User-agent: meta-externalagent
User-agent: FacebookBot
Disallow: /

Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →

User-Agent

meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) Crawlable/1.0; +https://crawlable.fr/probe

This is the string we send when probing. The Crawlable suffix identifies us in your logs.

Meta

Check your own site

robots.txt is only half the answer: your CDN can refuse Meta-ExternalAgent before it ever reads the file. A scan checks both.

Free, no account, about 5 seconds.