PageStat Blog » Domaining, News, SEM, SEO, Software

Robots.txt Generator

robots generator

robots generator

We’ve created a cool new robots.txt generator that is web based.

When wanting to hide a folder, file, or tell the search engines where our sitemap is without placing a direct link on the main page even we need help sometimes.

A robots.txt file is one of those things that you rarely edit, and therefore rarely re-use the syntax / commands. This tool will quickly generate all the data for you and even includes a link to a blank robots.txt file.


  • Google, Yahoo, MSN, Google Image allow or deny feature
  • sitemap location feature
  • folder deny feature (up to 4 folders)

Check it out and bookmark it. 🙂