Applebot
Apple's base crawler, powering Siri and Spotlight suggestions. Training use is controlled separately via Applebot-Extended.
Reference reviewed by Sona
| Operator | Apple |
|---|---|
| Powers | Siri and Spotlight suggestions, Apple Intelligence retrieval |
| Purpose | Search & answers |
| User-agent token | Applebot |
| Respects robots.txt | Yes |
Applebot is Apple's web crawler. It feeds Siri and Spotlight Suggestions and provides the retrieval layer Apple Intelligence features draw on when surfacing web content.
Applebot respects robots.txt. Whether the content it collects may also be used to train Apple's generative models is governed by the separate Applebot-Extended token - you can allow Applebot (stay in Siri/Spotlight) while disallowing Applebot-Extended (opt out of training).
Full user-agent string
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)
Allow Applebot
Your pages stay eligible to be surfaced by Siri, Spotlight, and Apple Intelligence answers across Apple devices.
User-agent: Applebot Allow: /
Block Applebot
You want your content out of Apple's ecosystem entirely - note this also removes you from Siri and Spotlight suggestions.
User-agent: Applebot Disallow: /
Can Applebot read your page right now?
Test any URL and see exactly what AI crawlers receive.