Bot reference catalog

One-page summaries of 30 common search, AI/LLM, and social-preview crawlers.

← bot index · audit index

Bingbot

Vendor
Microsoft
Type
Search
JavaScript rendering
yes
Honors robots.txt
yes
VendorMicrosoft
TypeTraditional search crawler
robots.txt tokenbingbot (also msnbot historically)
JavaScript renderingYes — Edge / Chromium-based since 2019
Honors robots.txtYes
Vendor docsbing.com/webmasters/help/which-crawlers-does-bing-use

User-Agent strings

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36

Mobile variant:

Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Related Microsoft bots: AdIdxBot (Bing Ads), MSNBot (legacy, mostly retired).

Purpose

The crawler that powers Bing search results, plus the search experiences that license Bing's index (DuckDuckGo, Yahoo!, Ecosia, AOL Search). Also feeds Microsoft Copilot's grounding pipeline.

Network identity

https://www.bing.com/toolbox/bingbot.json

In our audit

Bingbot reached 22/100 e-commerce sites successfully. Where blocked, it was blocked together with the AI bots — Cloudflare's "Block AI Bots" managed rule typically catches Bingbot as well unless explicitly allowlisted. This is a configuration bug at most sites that turn on the rule, since Bing search referrals are non-trivial revenue.

Bingbot was a beneficiary of dynamic rendering at amazon.co.uk (30× content over real Chrome), coupang.com (5×), and shopping.yahoo.co.jp (7×) — same trusted-crawler allowlist as Googlebot.

How to allow / block

User-agent: bingbot
Disallow: /private/

# Adjust crawl rate (Bingbot honors this; Googlebot does not)
User-agent: bingbot
Crawl-delay: 5

Quirks

with heavy client-side dependencies may have a longer indexing lag on Bing than on Google.

alternative for sites that want fast updates without waiting for Bingbot.

Sources