YandexBot
The crawler behind Yandex Search, dominant in Russia and parts of the CIS. Also feeds Yandex Market, Yandex News, and the broader Yandex product surface.
Specs
| Vendor | Yandex |
| Category | SEARCH |
| robots.txt token | Yandex (umbrella) · YandexBot (specific) |
| Renders JavaScript | partial JS |
| Honors robots.txt | yes |
| Reverse-DNS pattern | *.yandex.ru / *.yandex.net / *.yandex.com |
User-Agent string
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Considerations
- JS rendering is more limited than Google or Bing — SSR aggressively for Yandex-targeted sites.
- Honors Yandex-specific directives: Clean-param: (collapses URL variants) and Host: (canonical domain).
- Many sibling crawlers exist: YandexImages, YandexVideo, YandexNews, YandexMobileBot. The umbrella token Yandex covers them all.
robots.txt recipe
User-agent: Yandex
Allow: /
Clean-param: utm_source&utm_medium /catalog/Sources: Yandex Webmaster · Robot reference