Search Engines - Classic
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch EnginesSearch Engines - Classic

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old July 23rd, 2003, 06:07 PM
katja katja is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 7 katja User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 8 sec
Reputation Power: 0
Send a message via ICQ to katja
Unhappy please help with Inktomi

I started optimizing a website http://www.trapezeclub.com about 2 months ago and until 10 days ago it had #1 ranking for more than 10 search phrases in MSN and Hotbot.

Then, over night all the rankings disappeared (nothing in the first 100 results any more). I got the message that the site cannot be respidered because:

8006 ERROR_SITE: Failed to retieve robots.txt
Problem: The robots.txt file for your web site, could not be retrieved.
Solution: Please ensure that the robots.txt file returns either a 200 or 404 status code.

Can please somebody explain to me what is going on. As far as I know there are no robots.txt files there anyways.

Thanks in advance

Reply With Quote
  #2  
Old July 24th, 2003, 06:09 AM
awicked's Avatar
awicked awicked is offline
BlackHat SEO Pro ;)
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jul 2003
Location: Midlands.. UK
Posts: 328 awicked User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 11 h 33 m 21 sec
Reputation Power: 0
Hi, maybe worth trying adding a robot.txt file on your server. Just create a new text file with notepad and add the following:

User-agent: *
Disallow:

Then save as robots.txt and upload to your server. I had sort of the same problem with other bots where I could see they were hitting my site but they were requesting the robots.txt file and then getting a error_docs not found page because there was no robots file there. I made a robots.txt file and now they seem to crawl ok. Hope this helps.

Reply With Quote
  #3  
Old July 24th, 2003, 08:33 AM
katja katja is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 7 katja User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 8 sec
Reputation Power: 0
Send a message via ICQ to katja
Thank you - I will try that and will let you know whether it works or not.

Reply With Quote
  #4  
Old July 31st, 2003, 12:09 PM
katja katja is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 7 katja User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 8 sec
Reputation Power: 0
Send a message via ICQ to katja
hey awicked
Your suggestion helped - the site is back in Inktomi. However, all the positions are still lost.

Reply With Quote
  #5  
Old July 31st, 2003, 01:00 PM
awicked's Avatar
awicked awicked is offline
BlackHat SEO Pro ;)
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jul 2003
Location: Midlands.. UK
Posts: 328 awicked User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 11 h 33 m 21 sec
Reputation Power: 0
give it time. the inktomi bot takes time to crawl a site. people in these forums say it can take upto 6 months for the bot to crawl deep into your site.

Reply With Quote
  #6  
Old October 28th, 2003, 04:05 AM
Jeetsu Jeetsu is offline
Junior Member
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Oct 2003
Posts: 1 Jeetsu User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Re: please help with Inktomi

Quote:
Originally posted by katja
I started optimizing a website URL about 2 months ago and until 10 days ago it had #1 ranking for more than 10 search phrases in MSN and Hotbot.

Then, over night all the rankings disappeared (nothing in the first 100 results any more). I got the message that the site cannot be respidered because:

8006 ERROR_SITE: Failed to retieve robots.txt
Problem: The robots.txt file for your web site, could not be retrieved.
Solution: Please ensure that the robots.txt file returns either a 200 or 404 status code.

Can please somebody explain to me what is going on. As far as I know there are no robots.txt files there anyways.

Thanks in advance


Hi,

I've got exactly the same problem with a site !
And I really don't understand why because the file robots.txt exists on URL

I tried some tools which crawl the robots.txt file like URL and which found the file BUT found a error too : "There should be atleast 1 disallow line in any Robots.txt"
More incomprehensible cause the disallow line IS in !

& :-?

Help thx !

Last edited by Jeetsu : October 30th, 2003 at 08:20 AM.

Reply With Quote
  #7  
Old October 30th, 2003, 08:14 AM
derryt's Avatar
derryt derryt is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Aug 2003
Location: UK/NJ
Posts: 641 derryt User rank is Private First Class (20 - 50 Reputation Level)derryt User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 5 Days 2 h 57 m 50 sec
Reputation Power: 7
Send a message via AIM to derryt
I don't think this is anything to do with robots.text. It's to do with Inktomi changing the way results are displayed. They have altered their results to give a supposedly more accurate geographical bias. If you want to check your postioning without a regional bias use

http://search.positiontech.com/Inkt...nTechSearch.jsp

Inktomi have admitted that the results are flawed in some cases and are supposedly working to fix it.

HTH

Reply With Quote
  #8  
Old January 19th, 2004, 01:23 PM
blacksky blacksky is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2003
Posts: 5 blacksky User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
Send a message via AIM to blacksky
i need help with my ranks in inktomi

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch EnginesSearch Engines - Classic > please help with Inktomi


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump




 Free IT White Papers!
 
Create the Optimal Architecture for your Critical Applications
Warburton's the largest independently owned bakery in the UK faced a number of difficult challenges in providing the most robust yet efficient IT infrastructure for their organization's success. IBM's services combined with their xSeries servers created the perfect platform for their SAP environment with sufficient flexibility, and did so in very time effective fashion.

Request Your Free Technology Downloads!
 
Five Best Practices for Deploying a Successful Service-Oriented Architecture
This white paper describes the benefits you can expect with SOA, and how IBM can help take your business there.

Request Your Free Technology Downloads!
 
Gartner Magic Quadrant for Application Delivery Controllers
Gartner summarizes its view on Application Delivery Controllers, evaluates strengths and weaknesses of solutions, and provides Magic Quadrant reporting for a quick comparison across all vendors. Learn from Gartner how you can benefit from an all-in-one device like Citrix NetScaler that delivers the highest levels of availability, performance and security.

Request Your Free Technology Downloads!
 
Knowledge is Power
What you don't know can hurt you, and is likely costing you money and increasing your security risks during an era of scarce resources. This white paper proposes six key strategies that enterprise security managers can use to improve their network defense posture.

Request Your Free Technology Downloads!
 
Rationalizing the Multi-Tool Environment
The rationalized multi-tool approach is flexible, scalable and cost effective. It provides the necessary input to the IT service management business processes. It preserves prior investments in monitoring tools, empowers technologists to select the best tools with which to do their jobs, and enhances effective response to incidents.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 




© 2003-2010 by Developer Shed. All rights reserved. DS Cluster 12 Hosted by Hostway
For more Enterprise Application Development news, visit eWeek