Web Design and Development: Authoring: Online Tools: robots.txt

the entire directory only this category

Advanced Search

Home : Web Design and Development : Authoring : Online Tools : robots.txt

LINKS:

Robots.txt Checker
http://tool.motoricerca.info/robots-checker.phtml
Analyzes a robots.txt file searching for syntax and "logical" errors, and shows a summary of what effect it will have.

Robots.txt File Generator
http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/
Assists in creating robots.txt files for controlling page inclusion and exclusion in search engines.

Robots.txt Generator
http://www.robotstxt.ca/
Information on the use of robots.txt as well s a robots.txt generator and a list of search engine robots.

Robots.txt Syntax Checker
http://www.sxw.org.uk/computing/robots/check.html
Online tool for syntax verification to robots.txt files, provided by Simon Wilkinson.

Robots.txt Validation
http://www.clockwatchers.com/robots_tool.html
Creator and validator of robots.txt files.

Robots.txt Validator
http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Checks your robots.txt to insure it conforms to the robots exclusion standard.

HOME | ADD A LINK | MODIFY A LINK | LOGIN

© www.MiroWeb.com
Hosted by www.PremiumHostingService.com

Computers and Science

Artificial Intelligence