Free Robots.txt Generator

Create a custom robots.txt file for your website. Control search engine crawlers and protect sensitive areas. 100% free.

No sign-up required

User-Agent Rules

User-agent

Disallow (paths to block)

Allow (paths to explicitly allow)

No explicit allow rules

Sitemap URL

Help search engines find your sitemap

Crawl Delay (seconds, optional)

Time to wait between requests (not supported by all bots)

# robots.txt generated by LiteRanker

User-agent: *
Disallow: /admin/
Disallow: /private/

Sitemap: https://example.com/sitemap.xml

How to use this file

Save this as robots.txt and upload it to the root directory of your website (e.g., https://example.com/robots.txt).