|
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
| ||||||||||||||||||||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
I started optimizing a website http://www.trapezeclub.com about 2 months ago and until 10 days ago it had #1 ranking for more than 10 search phrases in MSN and Hotbot.
Then, over night all the rankings disappeared (nothing in the first 100 results any more). I got the message that the site cannot be respidered because: 8006 ERROR_SITE: Failed to retieve robots.txt Problem: The robots.txt file for your web site, could not be retrieved. Solution: Please ensure that the robots.txt file returns either a 200 or 404 status code. Can please somebody explain to me what is going on. As far as I know there are no robots.txt files there anyways. Thanks in advance |
|
#2
|
||||
|
||||
|
Hi, maybe worth trying adding a robot.txt file on your server. Just create a new text file with notepad and add the following:
User-agent: * Disallow: Then save as robots.txt and upload to your server. I had sort of the same problem with other bots where I could see they were hitting my site but they were requesting the robots.txt file and then getting a error_docs not found page because there was no robots file there. I made a robots.txt file and now they seem to crawl ok. Hope this helps. ![]() |
|
#3
|
|||
|
|||
|
Thank you - I will try that and will let you know whether it works or not.
|
|
#4
|
|||
|
|||
|
hey awicked
Your suggestion helped - the site is back in Inktomi. However, all the positions are still lost. |
|
#5
|
||||
|
||||
|
give it time. the inktomi bot takes time to crawl a site. people in these forums say it can take upto 6 months for the bot to crawl deep into your site.
|
|
#6
|
|||
|
|||
|
Re: please help with Inktomi
Quote:
Hi, I've got exactly the same problem with a site ! And I really don't understand why because the file robots.txt exists on URL I tried some tools which crawl the robots.txt file like URL and which found the file BUT found a error too : "There should be atleast 1 disallow line in any Robots.txt" More incomprehensible cause the disallow line IS in ! Help thx ! Last edited by Jeetsu : October 30th, 2003 at 08:20 AM. |
|
#7
|
||||
|
||||
|
I don't think this is anything to do with robots.text. It's to do with Inktomi changing the way results are displayed. They have altered their results to give a supposedly more accurate geographical bias. If you want to check your postioning without a regional bias use
http://search.positiontech.com/Inkt...nTechSearch.jsp Inktomi have admitted that the results are flawed in some cases and are supposedly working to fix it. HTH |
|
#8
|
|||
|
|||
|
i need help with my ranks in inktomi
|
![]() |
| Viewing: SEO Chat Forums > Search Engines > Search Engines - Classic > please help with Inktomi |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
|