Robots.txt Generator
Set the paths to disallow and your sitemap URL to instantly generate a ready-to-use robots.txt file.
Pourquoi utiliser cet outil ?
A robots.txt file tells search engines which parts of your site to crawl or ignore. This tool generates a syntactically correct robots.txt live, from the paths you want to exclude and your sitemap URL.