
November 28th, 2005, 09:00 AM
|
|
Utility Bot
|
|
Join Date: Oct 2003
Posts: 752

Time spent in forums: < 1 sec
Reputation Power: 6
|
|
|
Advanced Use of Robots.txt
With all of the SEO tips, tricks, and tutorials available to you, probably the easiest to achieve is the use of the robots.txt file. This is a simple file that gives instructions to search engine robots, or spiders, on how to crawl your website, and which files and directories to stay out of, and to not index in their databases.
Read the full article here: Advanced Use of Robots.txt
For more discussion go here: Blog Article Discussion
|