Difference between revisions of "Robots.txt"

From Cyborg Anthropology
Jump to: navigation, search
(Created page with '===Definition=== "Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. ===External Links=== http://www…')
(No difference)

Revision as of 17:33, 1 February 2011

Definition

"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.

External Links

http://www.javascriptkit.com/howto/robots.shtml