SEARCH · DuckDuckGo

DuckDuckBot

DuckDuckGo's own crawler. Used for Instant Answers and a small supplemental index. The bulk of DuckDuckGo's search results are licensed from Bing — site visibility there is mostly controlled by Bingbot access.

Specs

VendorDuckDuckGo
CategorySEARCH
robots.txt tokenDuckDuckBot
Renders JavaScriptHTTP only
Honors robots.txtyes

User-Agent string

DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)

Considerations

  • Low traffic volume. Most sites see it less than once a day.
  • Disallowing DuckDuckBot only blocks the Instant-Answers crawl. Bing-licensed results continue.
  • DuckDuckGo also runs DuckAssistBot for its AI features, with its own token.

robots.txt recipe

User-agent: DuckDuckBot
Allow: /

Sources: DuckDuckGo · DuckDuckBot reference

← Back to directory