robots.txt generator
Create a basic robots.txt file with Allow, Disallow, and Sitemap rules.
User-agent: *
Allow: /
Disallow: /admin
Disallow: /cuenta
Sitemap: https://ejemplo.com/sitemap.xmlHow it works
Set the user-agent, add allowed or blocked paths, and optionally enter your sitemap URL. The tool generates the robots.txt content.
Frequently asked questions
Does Robots.txt prevent a URL from appearing on Google?
Not necessarily. robots.txt controls crawling but does not guarantee removal from search indexes.
Where should robots.txt be placed?
It is usually published at the domain root, for example https://ejemplo.com/robots.txt.