Google Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsGoogleGoogle Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old August 29th, 2007, 10:24 PM
sosh's Avatar
sosh sosh is offline
time for breakfast
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Feb 2005
Location: ATL
Posts: 295 sosh User rank is Lance Corporal (50 - 100 Reputation Level)sosh User rank is Lance Corporal (50 - 100 Reputation Level)sosh User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 2 Days 57 m 41 sec
Reputation Power: 5
Send a message via MSN to sosh
Network Unreachable - Robots.txt Unreachable

So I just started with a new company running their internet marketing department. It was like an SEOers dream/nightmare (I get 3% of increase in online sales so maybe dream). The site had not been crawled or cashed in over two months. There were a few pages left, but mostly they were just relying on PayPer click. The sad thing was it took me two weeks to solve the problem.

To try and solve the problem I turned to Google's Webmaster Tools. I tried submitting a sitemap and found that they could not pick it up, despite the fact that it was obviously there and there was nothing wrong with the syntax. Futher research into the issue suggested that it could be a DNS error. After two weeks of wrapping my mind around there overly complex setup I finally switched IPs (but not servers) and presto! the sitemap file was readable the next morning.

In my reasearch I noticed there were others having this problem and most of the suggestions were **** like check to see if the file was there or make sure you're xml is encoded properly, blah blah blah, and not really talking the problem seriously, so I wanted to share to those of you who might be having this problem IT IS A DNS ERROR. Bitch to tech support. Get a new IP. Change DNS servers if you have to, but it is a DNS error.

Thats all. Anyone else see this problem?

Reply With Quote
  #2  
Old August 29th, 2007, 11:49 PM
rtchar's Avatar
rtchar rtchar is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jul 2005
Location: Canada
Posts: 762 rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 1 Week 6 Days 19 h 40 m 53 sec
Reputation Power: 13
Incorrect server setup and bad DNS data can happen.

But since most websites are on professionally managed hosting severs that is a rare a problem.

Actually I am a little confused ... your site was visible on the Internet and visitors could view your web pages ... but robots could not access the files?

Something is amiss here ...
Comments on this post
sosh agrees: thanks for you interest in this starge issue
__________________
Personal Breathalyzers
Breath Tester

Street Defender

Reply With Quote
  #3  
Old August 31st, 2007, 09:44 AM
sosh's Avatar
sosh sosh is offline
time for breakfast
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Feb 2005
Location: ATL
Posts: 295 sosh User rank is Lance Corporal (50 - 100 Reputation Level)sosh User rank is Lance Corporal (50 - 100 Reputation Level)sosh User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 2 Days 57 m 41 sec
Reputation Power: 5
Send a message via MSN to sosh
Yeah, visible to everyone, but Google and Yahoo were both having problems. And we host with a big hosting company (the plannet). It was hard to find anyone who had had the same problem, but its an issue that has seemed to crop up only within the past few months. Strange right?

Reply With Quote
  #4  
Old September 1st, 2007, 12:36 AM
rtchar's Avatar
rtchar rtchar is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jul 2005
Location: Canada
Posts: 762 rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level)rtchar User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 1 Week 6 Days 19 h 40 m 53 sec
Reputation Power: 13
DNS converts domain name to IP address and obviously it was doing that or the site would not be accessible.

Where I am having a problem is that content files were visible, but *.txt and *.xml could not be read.

To be honest it sounds more like a server configuration error ... file permissions or htaccess. However, changing the IP address would not solve these problems.

Just be glad someone fixed the issue and you can move on.

Reply With Quote
Reply

Viewing: SEO Chat ForumsGoogleGoogle Optimization > Network Unreachable - Robots.txt Unreachable


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway
Stay green...Green IT