Yahoo Search Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch EnginesYahoo Search Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old December 29th, 2004, 11:08 AM
Sweat Sweat is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 282 Sweat User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 17 h 4 m 32 sec
Reputation Power: 7
Help - Yahoo Only Indexes My Homepage

My home page has been listed in Yahoo for years. However, the only page of my site that Yahoo lists is the home page.

I'd like to try and see if I can troubleshoot the problem. So here are a few details.

Yahoo Spiders - I'm not seeing any evidence that Yahoo is crawling my site. Here's what I have entered in Happy Log to identify as Yahoo and Inktomi spiders:
Slurp.so/1.0
Yahoo! Slurp
Slurp

Meta Tags - Here is what I have listed on my home page for robot instructions:
<meta name="RATING" content="General">
<meta name="ROBOTS" content="index,follow">
<meta name="ROBOTS" content="ALL">

robots.txt - I have a blank robots.txt file on my site. It is not linked to by the site map.

Site Map - this linked to from every page on my site. The page has hyperlinked key phrase descriptions of every page.

Any ideas on what I can do to get Yahoo to crawl my entire site?

Reply With Quote
  #2  
Old December 29th, 2004, 02:36 PM
Vetteman18's Avatar
Vetteman18 Vetteman18 is offline
SEO Theorist
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2004
Location: Long Island, New York
Posts: 356 Vetteman18 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 5 h 31 m 27 sec
Reputation Power: 5
Get into the Yahoo directory. I just got in and they are pounding me with spiders.

Reply With Quote
  #3  
Old December 29th, 2004, 02:39 PM
Sweat Sweat is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 282 Sweat User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 17 h 4 m 32 sec
Reputation Power: 7
Quote:
Originally Posted by Vetteman18
Get into the Yahoo directory. I just got in and they are pounding me with spiders.



My home page is already listed on Yahoo. Do I need to resubmit the url for the home page and hope it crawls the entire site?

Reply With Quote
  #4  
Old January 4th, 2005, 01:20 AM
mike123 mike123 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2004
Posts: 43 mike123 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 7 h 40 m 42 sec
Reputation Power: 5
I am experiencing the same problem on two of my prominent sites. yahoo indexes only the homepage. Is there any other way to get listed in yahoo other than submitting the site in the yahoo directory???

Reply With Quote
  #5  
Old January 15th, 2005, 12:23 AM
tommytom tommytom is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jan 2005
Posts: 4 tommytom User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
should you continually resubmit your site to be crawled if they havent crawled your site in awhile? I have heard some say that it is not wise to resubmit your site to be crawled too frequently. Is this true, thoughts?

_________________________________________
nc website design company - TvLaLa Consulting

Reply With Quote
  #6  
Old January 15th, 2005, 08:33 AM
Sweat Sweat is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 282 Sweat User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 17 h 4 m 32 sec
Reputation Power: 7
Quote:
Originally Posted by gchaney
I would suggest building multiple deep links to your site including to your site map.


I have had multiple deep links for well over a year and it has not made a single difference. Yahoo just continues to act is if my site only has two pages.

Reply With Quote
  #7  
Old January 15th, 2005, 02:52 PM
bbott's Avatar
bbott bbott is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jul 2004
Location: New Jersey
Posts: 303 bbott User rank is Private First Class (20 - 50 Reputation Level)bbott User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 11 h 20 m 28 sec
Reputation Power: 5
Send a message via MSN to bbott
Here is an idea...

If you post often on forums, why not try putting different links in your sig. For example one forum you could link to the homepage, one forum your sig could link to internal pages, one could link to some more internal pages... etc.

Also, keep in mind that Yahoo! takes longer to index sites than Google...

Last edited by bbott : January 15th, 2005 at 04:02 PM.

Reply With Quote
  #8  
Old January 16th, 2005, 06:05 PM
outland88's Avatar
outland88 outland88 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2003
Posts: 337 outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 6 Days 20 h 18 m 13 sec
Reputation Power: 7
You're in the same boat as a lot of people Sweat. I've got a 1000 backlinks, even more in Google, so that is not the cause. Its some type of penalization that only allows the index page. The problem seems most related to directory sites but not all. You can also look at your pages for duplicated content and possibly excessive crosslinking. Yahoo is not going to tell anybody what the problem is.

Reply With Quote
  #9  
Old January 16th, 2005, 11:01 PM
Sweat Sweat is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 282 Sweat User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 Day 17 h 4 m 32 sec
Reputation Power: 7
What continues to kill me is that Slurp comes by, visits six or eight pages and then leaves.

I'm not convinced that the duplicate content is the problem everyone says it is. It it was, then any site with a manufacturer's description of a product - including Amazon and Barnes and Noble - would be penalized.

Excessive cross-linking isn't a problem either since there are many, many more sites linking to mine than I'm linking back out to.

There's something else going on with Yahoo that has been going on for a very long time. I just wish I knew what.

Reply With Quote
  #10  
Old January 21st, 2005, 04:46 AM
hagionet hagionet is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jan 2005
Posts: 1 hagionet User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 0
make the robot.txt file and tell him to disallow some contents which slurp dont like. then it will check your site mostly. you can check this site:
URL

This site is only listed in yahoo with one indexed page. when there was no robot.txt file then it was saying, future indexing zero and when i put the .txt then it is saying future indexing infinity. so the only way i think this way. although i just tested it today. and waiting for one week, what will happened with the robot.txt file. let me see.

Last edited by hagionet : January 21st, 2005 at 04:48 AM. Reason: Forget to giving some informations.

Reply With Quote
  #11  
Old January 21st, 2005, 06:22 PM
outland88's Avatar
outland88 outland88 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2003
Posts: 337 outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level)outland88 User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 6 Days 20 h 18 m 13 sec
Reputation Power: 7
I've been told by many Yahoo is not observing the robots.txt file or no index meta tags even though Yahoo's states the opposite. To override the penalties some people have told me they just mirrored their sites to new domains and created an htacess file to stop bots from Google and MSN. Most said their new sites popped right back in less than a week. But I don’t know what happened after that. My main concern with a mirrored site would be hurting yourself in Google or the new MSN. Bird in the hand is worth more than two in the bush.

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch EnginesYahoo Search Optimization > Help - Yahoo Only Indexes My Homepage


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 2 hosted by Hostway
Stay green...Green IT