Twitterbot
| Vendor | X (formerly Twitter) |
| Type | Social link-preview bot |
| robots.txt token | Twitterbot |
| JavaScript rendering | No |
| Honors robots.txt | Partial (similar policy to facebookexternalhit) |
| Vendor docs | developer.x.com/en/docs/tweets/optimize-with-cards |
User-Agent string
Mozilla/5.0 (compatible; Twitterbot/1.0)Purpose
Fetches URLs shared in tweets to render the Twitter Card preview. Reads twitter:card, twitter:title, twitter:image, and falls back to og:* tags.
Quirks
- Static HTML required for cards. SPAs that don't SSR card metadata
will have blank previews on X.
- Fetches the head and a small body window only.
- The bot has not been substantively updated since the X rebrand;
the UA still says "Twitterbot".
How to control
<meta name="twitter:card" content="summary_large_image">
<meta name="twitter:title" content="...">
<meta name="twitter:image" content="...">
<meta name="twitter:description" content="...">