Robots.txt Generator
Create a robots.txt file for your website in seconds.
Quick Templates
Step 1 — Website URL
Step 2 — Search Engine Access
Step 3 — Sitemap
Step 4 — Crawler Rules
Advanced Options
⚠️ Only block URLs that search engines should not crawl. Incorrect robots.txt rules can prevent crawling.
Your robots.txt
User-agent: *
Allow: /
Copied!
✓ Robots.txt looks good
📖 How to Use This Tool
1
Enter Website Details: Type your domain URL (e.g., https://example.com) in Step 1.
2
Configure Access & Sitemap: Choose default search engine permissions and enable your XML Sitemap URL if needed.
3
Set Crawler Rules: Check the boxes to block admin, search, or temporary paths, or add custom User-agent rules under Advanced Options.
4
Generate & Export: Click "Generate robots.txt" to validate your file, then Copy or Download it directly to your site's root directory.