Bot reference catalog

One-page summaries of 30 common search, AI/LLM, and social-preview crawlers.

← bot index · audit index

DuckDuckBot

Vendor
DuckDuckGo
Type
Search
JavaScript rendering
no
Honors robots.txt
yes
VendorDuckDuckGo
TypeSearch crawler (used as a small supplemental index; primary index licensed from Bing)
robots.txt tokenDuckDuckBot
JavaScript renderingNo
Honors robots.txtYes
Vendor docsduckduckgo.com/duckduckbot

User-Agent string

DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)

Purpose

DuckDuckGo's own light crawler. Used for its Instant Answers feature and a small supplemental index. The bulk of DuckDuckGo's search results are licensed from Bing — so a site's DuckDuckGo visibility is mostly controlled by bingbot access, not DuckDuckBot.

Network identity

How to allow / block

User-agent: DuckDuckBot
Disallow: /

Note that disallowing DuckDuckBot only blocks the Instant-Answers crawl; the Bing-licensed index will continue to surface the site as long as Bingbot has access.

Quirks

features, with its own UA token.

Sources