SEARCH · Baidu

Baiduspider

The crawler behind Baidu Search. Notably weaker JS rendering than Google or Bing — dynamic rendering is still recommended by Baidu itself for SPA-heavy sites.

Specs

VendorBaidu
CategorySEARCH
robots.txt tokenBaiduspider
Renders JavaScriptHTTP only
Honors robots.txtyes
Reverse-DNS pattern*.baidu.com

User-Agent string

Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Considerations

  • Our v1 audit found baidu.com itself serves declared bot UAs a fully pre-rendered ~250 KB HTML while Chrome receives a 357-character shell. Textbook dynamic rendering at the world's fourth-largest search engine.
  • Sibling spiders for images, video, news, favorites — each with its own UA token.
  • No publicly enumerable IP-range JSON. Reverse-DNS to *.baidu.com is the standard check.

robots.txt recipe

User-agent: Baiduspider
Allow: /

Sources: Baidu Help · Spider FAQ

← Back to directory