Robots.txt File Generator Create and optimize search engine crawling instructions General Settings Default - All Robots are: Allowed Disallowed Crawl-Delay: Default - No Delay 5 Seconds 10 Seconds 20 Seconds 30 Seconds 60 Seconds Sitemap: Search Robots Restricted Directories Add Directory Reset All Settings Your Generated Robots.txt File
