Skip to content
Crawlable
frSign in
AI searchBlocking it costs you visibility

ExaSearchBot

Exa is the retrieval layer behind a long tail of AI products and agents.

robots.txt token
ExaSearchBot
ExaBot
Operator
Exa ↗
Powers
Exa search API used by many AI apps
Honours robots.txt
Not documented

Allow it

User-agent: ExaSearchBot
Allow: /

Block it

User-agent: ExaSearchBot
User-agent: ExaBot
Disallow: /

Need the whole file, with every crawler and your private paths — and the llms.txt to go with it? The generator writes them. AI config generator →

User-Agent

Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://exa.ai) Crawlable/1.0; +https://crawlable.fr/probe

This is the string we send when probing. The Crawlable suffix identifies us in your logs.

Check your own site

robots.txt is only half the answer: your CDN can refuse ExaSearchBot before it ever reads the file. A scan checks both.

Free, no account, about 5 seconds.