We’ve created a cool new robots.txt generator that is web based.
When wanting to hide a folder, file, or tell the search engines where our sitemap is without placing a direct link on the main page even we need help sometimes.
A robots.txt file is one of those things that you rarely edit, and therefore rarely re-use the syntax / commands. This tool will quickly generate all the data for you and even includes a link to a blank robots.txt file.
- Google, Yahoo, MSN, Google Image allow or deny feature
- sitemap location feature
- folder deny feature (up to 4 folders)
Check it out and bookmark it. 🙂