Take Control of Your Website with a Robots.txt Generator


Default - All Robots are:
Crawl-Delay:
Sitemap:
Search Robots:

Google

Google Image

Google Mobile

MSN Search

Yahoo

Yahoo MM

Yahoo Blogs

Ask/Teoma

GigaBlast

DMOZ Checker

Nutch

Alexa/Wayback

Baidu

Naver

MSN PicSearch

Restricted Directories:
The path is relative to root and must
contain a trailing slash "/"











Copy to Clipboard