Search Engines Bots & Crawlers
Traditional search engine crawlers that index web content for search results. These bots form the backbone of web discoverability and are essential for SEO.
Applebot
Search EnginesApple
Apple's search crawler powering Siri, Spotlight, and Safari Suggestions.
UA: Applebot, applebot
Baiduspider
Search EnginesBaidu
Baidu's web crawler serving the dominant search engine in China.
UA: Baiduspider, baiduspider
Bingbot
Search EnginesMicrosoft
Microsoft Bing's search crawler, also powering Copilot AI answers.
UA: bingbot, Bingbot, msnbot
Claude-SearchBot
Search EnginesAnthropic
Anthropic's search indexing crawler for Claude's search features.
UA: Claude-SearchBot
DuckDuckBot
Search EnginesDuckDuckGo
DuckDuckGo's web crawler for the privacy-focused search engine.
UA: DuckDuckBot, duckduckbot
Googlebot
Search EnginesGoogle's primary web crawler powering the world's largest search engine.
UA: Googlebot, googlebot, Google-InspectionTool
OAI-SearchBot
Search EnginesOpenAI
OpenAI's search indexing crawler for ChatGPT Search features.
UA: OAI-SearchBot
YandexBot
Search EnginesYandex
Yandex's web crawler for the leading search engine in Russia and CIS.
UA: YandexBot, yandexbot
Explore Other Categories
Manage all search engines with Switch
Detect, track, and build custom response journeys for every search engines visiting your site. Five-minute setup.
Get Started Free