YouBot
You.com's crawler - indexes pages for its AI search engine, where cited sources link back to your site.
Reference reviewed by Sona
| Operator | You.com |
|---|---|
| Powers | You.com AI search answers and citations |
| Purpose | Search & answers |
| User-agent token | YouBot |
| Respects robots.txt | Yes |
YouBot builds the index behind You.com, one of the earliest AI-native search engines, which answers queries with generated summaries and linked citations.
YouBot publishes its user-agent and respects robots.txt directives for its token.
Full user-agent string
Mozilla/5.0 (compatible; YouBot (+http://www.you.com))
Allow YouBot
Eligibility to be cited in You.com's AI answers - another referral channel from AI-native search.
User-agent: YouBot Allow: /
Block YouBot
You prefer not to appear in You.com's answer interface.
User-agent: YouBot Disallow: /
Can YouBot read your page right now?
Test any URL and see exactly what AI crawlers receive.