#1
  1. No Profile Picture
    Toe
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2003
    Posts
    2
    Rep Power
    0

    "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"?


    Just noticed that today in my logs, right alongside the plain "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" that I'm used to. I don't think I've ever seen it as 'mozilla compatible', is this something new?

    A lookup on the IP (64.68.83.6) confirms it as Google's.
  2. #2
  3. No Profile Picture
    Posts: 20, 574 (I wish!)
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Jun 2004
    Posts
    764
    Rep Power
    11
    Originally Posted by Toe
    Just noticed that today in my logs, right alongside the plain "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" that I'm used to. I don't think I've ever seen it as 'mozilla compatible', is this something new?

    A lookup on the IP (64.68.83.6) confirms it as Google's.
    Strange

    Dan

    p.s. I'll check my logs..
  4. #3
  5. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2004
    Location
    Canada
    Posts
    31
    Rep Power
    10
    Originally Posted by Toe
    Just noticed that today in my logs, right alongside the plain "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" that I'm used to. I don't think I've ever seen it as 'mozilla compatible', is this something new?

    A lookup on the IP (64.68.83.6) confirms it as Google's.
    I emailed Google about this one last week and they've confirmed that they report their user agent as "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" , ""Googlebot/2.1 (+http://www.google.com/bot.html)", and "Googlebot/2.1 (+http://www.googlebot.com/bot.html)".

    I track all IPs of user agents containing either "google" or "slurp" that hit my domains. The results are posted here: http://www.spidertrack.org/index.php...otFraud#Table2 and http://www.spidertrack.org/index.php...&spider=google.
  6. #4
  7. Contributing User
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Apr 2004
    Posts
    1,547
    Rep Power
    17
    I was sending a bunch of spam reports on one of our test domains and this baby came around. I guess they want to check for badly preformed cloaking ;-)
  8. #5
  9. The Master
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jul 2004
    Location
    London
    Posts
    250
    Rep Power
    11
    Just looking for user agent cloaking i would say.
  10. #6
  11. No Profile Picture
    Posts: 20, 574 (I wish!)
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Jun 2004
    Posts
    764
    Rep Power
    11
    I can confirm that this is an Official Googlebot name.

    However, it can still be spoofed, always check IP for confirmation

    Dan
  12. #7
  13. No Profile Picture
    Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Apr 2004
    Posts
    172
    Rep Power
    11
    I was just about to give up on my new stats package from www. weppos.com (italian but they have a decent english translation too) because I knew Google was hitting my sites but it wasn't being logged.. MSN, etc. we're all being recorded, but no Google.

    I wrote to the stats package maker and they said it was a known shortcoming as Google wouldn't follow the Javascript that launches the 'hit counter'..

    Yesterday, i saw a 'Google' with a question mark logo (unidentified) show up in the logs. So, I can only assume this is the mozilla based version of the spider and/or it's learned how to follow a javascript link like the following:

    <script type="text/javascript" language="JavaScript" src="www. domain.com/mystats/stats.asp"> </script>


    Originally Posted by ih8google
    I can confirm that this is an Official Googlebot name.

    However, it can still be spoofed, always check IP for confirmation

    Dan

Similar Threads

  1. Yahoo Crawler Bugs??
    By Darrin Ward in forum BING/Yahoo Search Optimization
    Replies: 2
    Last Post: May 12th, 2004, 04:54 PM
  2. Replies: 2
    Last Post: Oct 17th, 2003, 03:43 PM
  3. How do you tell when Googlebot visits?
    By whereisgoogle in forum Google Optimization
    Replies: 4
    Last Post: Aug 13th, 2003, 07:37 AM
  4. Cool script: Emails you when googlebot hits your domain (*)
    By Angus in forum Web Design, Coding and Programming
    Replies: 98
    Last Post: Jul 12th, 2003, 12:14 AM
  5. Dancing Again?
    By chelsel in forum Google Optimization
    Replies: 2
    Last Post: Feb 1st, 2003, 09:33 AM

IMN logo majestic logo threadwatch logo seochat tools logo