|
|||||||||
|
|||||||||
|
|||||||||
 |
|||||||||
| |
||
|
|
|
|
|||||||||
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
|
|
|
| |||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
SEO Chat Forums Sponsor:
|
|
|
|
#1
January 1st, 2005, 05:30 AM
|
|||
|
|||
|
"No robots.txt file" I'm told, but I have one?
"You have no robots.txt file. Spiders check this file to see if any parts of your website should not be spidered." This is the message I get for this page from spidertest dot com But I have a valid robots.txt file on the server, why do I get this message?
The page in question is this one - http:// design.tmhdesign . com /tasty_tuscany
|
|
#2
January 1st, 2005, 05:49 AM
|
||||
|
||||
|
All bots (except maybe Googlebot) only accept robots.txt if it is in the ROOT of your domain.
Of course this means that you'd also have to add /tasty_tuscany in front of every disallowed dir, so they would read: Disallow: /tasty_tuscany/databases/ etc. If you don't have access to the root, you might want to ask the owner of that to include your lines. Alternatively you can add the robots meta tag, but that would have to go on ALL your disallowed pages... Lot of work.
__________________
...please help me w/ the real Redscowl Bluesingsky...how2 check backlinks...now postin' @ SEO Refugee ...
·<°`)~ LOL now that I finally have a paypal account, I'm charging 19,- for SEO advice via PM. Seriously...
|
|
| Viewing: SEO Chat Forums > Search Engine Strategies > Search Engine Optimization > "No robots.txt file" I'm told, but I have one? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
 |
|
|
|
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
