cohere-ai
Cohere's crawler, gathering content to train its enterprise-focused language models.
| Operator | Cohere |
|---|---|
| Powers | Cohere's enterprise language models |
| Purpose | Model training |
| User-agent token | cohere-ai |
| Respects robots.txt | Yes |
The cohere-ai token identifies crawling associated with Cohere, a provider of enterprise language models used in business search and generation products.
Add a cohere-ai rule to robots.txt to allow or disallow this access.
Allow cohere-ai
Your content can be represented in Cohere-powered enterprise AI products.
User-agent: cohere-ai Allow: /
Block cohere-ai
Keep your content out of Cohere's training data.
User-agent: cohere-ai Disallow: /
Can cohere-ai read your page right now?
Test any URL and see exactly what AI crawlers receive.