Robots.txt Generator

We’ve created a cool new robots.txt generator that is web based.

When wanting to hide a folder, file, or tell the search engines where our sitemap is without placing a direct link on the main page even we need help sometimes.

A robots.txt file is one of those things that you rarely edit, and therefore rarely re-use the syntax / commands. This tool will quickly generate all the data for you and even includes a link to a blank robots.txt file.

Features

• Google, Yahoo, MSN, Google Image allow or deny feature
• sitemap location feature
• folder deny feature (up to 4 folders)

Check it out and bookmark it.
http://pagestat.com/robots-generator.php

Tags: generate a robots.txt, google robots.txt generator, robots generator, robots text file, robots text file generator, robots txt cgi bin, robots txt disallow googlebot, robots.txt disallow, robots.txt disallow all, robots.txt disallow directory, robots.txt disallow everything, robots.txt disallow file, robots.txt disallow wildcard, robots.txt sitemap