Robots.txt generator tool

Index the site for all robots?

Delay in sec.

XML Sitemap:

Disallow indexing path (each path on a new line) Example: /catalog/

Allow indexing path (each path on a new line) Example: /catalog/

Your Robots.txt

Robots.txt is a text file that goes into the domain root and is crawled by search engines. It contains thorough directives regarding webpages’ indexation for crawlers. The accuracy and speed of a website’s indexing depend directly on the validity of a robots.txt file, so search engines like Google can identify which pages from a website are not relevant.

This tool allows fast generating robots.txt files that must be copied and saved at the domain root of a website. To generate a text, you just need to choose a search engine that you find suitable for indexing (or you can also choose to not index any search engines you’d like) and enter a website’s sitemap into an input bar.