🤖
Robots.txt Generator
Create, visualize, and validate robots.txt directives to control how search engines crawl your site
⚡
Quick Presets
🌐 Default (Allow All)
📝 WordPress
⚛️ Next.js / React
🛒 E-commerce
🔧 API / SaaS
🚫 Block All
🤖
Custom Rules
Sitemap URL
Host (optional)
Crawl Delay (optional, in seconds)
User-Agent Rules
Allow
Disallow
✕
+ Add Rule
Common Disallow Paths
/admin/
/api/
/private/
/search
/login, /register, /auth/
/tmp/, /cache/
⚡ Generate robots.txt
📋 Copy