🤖 Robots.txt Generator

Create a valid robots.txt file for your website. Control which pages search engine crawlers can access.

Global Settings (All Bots)

Default Rule for All Crawlers

Disallowed Paths (one per line, e.g. /admin/)

Allowed Paths (override disallowed, one per line)

Specific Bot Rules

Sitemap

Sitemap URL

Generated robots.txt