Thread: Lazy Slurp?

    #1
  1. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2005
    Location
    I have no Idea!
    Posts
    45
    Rep Power
    14

    Lazy Slurp?


    My new site is up for a month now. I have been properly crawled and indexed by MSNbot (and ranking first page for my main keywords) and by GoogleBot. Slurp only nibbled on my Robots.txt 2 times and never quiete got in. Do Yahoo often are the last to crawl a site?
  2. #2
  3. Croatia - Hrvatska
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    May 2005
    Location
    Croatia - Hrvatska
    Posts
    1,891
    Rep Power
    19
    Do Yahoo often are the last to crawl a site?
    for me not, try to get more bL (maybe stupid advice but i do that when i don't know what to do )
  4. #3
  5. SEO Earthquake!
    SEO Chat Scholar (3000 - 3499 posts)

    Join Date
    Jun 2005
    Location
    Sacramento, CA
    Posts
    3,307
    Rep Power
    25
    Y! can be the last to index your site because they want you to pay for submision. You can be patient and they'll get around to it.

    OR!

    Set up an RSS feed and create a My Yahoo! account and submit the feed to your account. This will make Y! aware of your site and they will crawl it faster. This also works for MSN.
    14th Colony: The hardest working websites online!

    Looking for links? Join the Union and don't miss English Grammar rules, tips and explanations
  6. #4
  7. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2005
    Location
    I have no Idea!
    Posts
    45
    Rep Power
    14
    Originally Posted by rmccarley
    Set up an RSS feed and create a My Yahoo! account and submit the feed to your account. This will make Y! aware of your site and they will crawl it faster. This also works for MSN.
    Done that in the first week the site was up. I think that's why Y! looked at my Robots.txt at the first place. But no crawls since then, not even Robots.txt hits from Y!.

    Oha, and I have a TON of BL's already. I've submited to a bunch of Dir's etc... I really don't think it's the case...
  8. #5
  9. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Aug 2005
    Location
    Online
    Posts
    136
    Rep Power
    14
    I also notice that yahoo is lazy in crawling. It's been months and still they come the least and do really fast surface crawls without venturing too far into my whole site, while all others have already crawled deep many many times.
  10. #6
  11. SEO Earthquake!
    SEO Chat Scholar (3000 - 3499 posts)

    Join Date
    Jun 2005
    Location
    Sacramento, CA
    Posts
    3,307
    Rep Power
    25
    Isn't it funny how people are complaining about Y! not crawling their site while Y! is out there touting how big their DB is? Oddly, they show an extra 40 pages for my site that never existed and have garbage titles. I don't wear a tinfoil hat but if I did, I'd say its almost like Y! doesn't want to know how crappy their DB is...
  12. #7
  13. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2005
    Posts
    12
    Rep Power
    0

    yahoo sitemap


    I saw a post here somewhere about Yahoo having a sitemap that it prefers, but I can't remember where I saw it, I think it was posted by Gary the Scuba Guy. You might want to look into that as well.
  14. #8
  15. <-- No I am not Kermit
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Mar 2005
    Location
    Fort Worth, TX
    Posts
    1,015
    Rep Power
    19
    I'm not sure which is slower to arrive: getting free of the sandbox, Yahoo's indexing a site, or Christmas.

    If you're doing well in MSN and G, then the best thing you can do is be patient with Y. If you really want, you can pay the $$$ to get listed in Yahoo's directory, but I'm not convinced completely that it makes a major difference in the long run.

    Regarding dir BL, I'd not depend on them as many SE are devaluing them. Rather, go after regular BL from actual pages that are related/associated to your site.

    Comments on this post

    • rmccarley agrees : Definately getting out of the sandbox.
    SEO Tips

    SEO Consulting $50/hr - IM me for details *** PayPal available
  16. #9
  17. No Profile Picture
    Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jul 2005
    Location
    So-Cal
    Posts
    108
    Rep Power
    14
    Try the RSS feed submission to My Yahoo. It got my site crawled daily within a few weeks. However, it still didn't get me out of the sandbox (at least, that's what I blame my crappy Yahoo rankings on, whether or not it's true!).

Similar Threads

  1. From Yahoo - Robots.txt on your site is blocking Yahoo! Slurp crawler
    By gchaney in forum BING/Yahoo Search Optimization
    Replies: 4
    Last Post: Aug 22nd, 2005, 11:05 PM
  2. Your top 5 "get google rankings" to do list.
    By mark-connect in forum Google Optimization
    Replies: 44
    Last Post: Jun 19th, 2005, 11:50 AM
  3. What is this?
    By rten2005 in forum BING/Yahoo Search Optimization
    Replies: 2
    Last Post: Mar 20th, 2005, 03:57 PM
  4. Question About Giving Slurp Instructions
    By Sweat in forum BING/Yahoo Search Optimization
    Replies: 11
    Last Post: Jan 8th, 2005, 05:34 PM

IMN logo majestic logo threadwatch logo seochat tools logo