Robots.txt Generator
Build a simple robots.txt file by choosing crawler access rules and adding your sitemap URL.
Generated robots.txt
Your robots.txt rules will appear here.
Blogger users: Blogger has its own robots.txt and custom robots header settings. Do not replace or publish custom rules unless you understand the effect. Incorrect Disallow rules can prevent search engines from crawling important pages. Robots.txt controls crawling, not guaranteed de-indexing. Never use this file to hide private or confidential information.