#1
  1. Moderator
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Sep 2016
    Location
    United Kingdom
    Posts
    1,374
    Rep Power
    1316

    Locations Googlebot crawls from?


    I've read some conflicting resources as to where Google bot crawls from.

    It seems their bots crawl from muiltiple locations, but which? In a project I'm creating, the hero image changes based on the users location - so knowing where Googlebot comes from is important to me. Does anyone keep tabs on this?
    Last edited by matt1966; Mar 28th, 2018 at 12:57 PM.
  2. #2
  3. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Feb 2018
    Posts
    27
    Rep Power
    0
    This is a really interesting question and I'm curious about this as well. I would start by considering the actual locations of Google data centers (https://www.google.com/about/datacen...ons/index.html). Is it just the image that is being served dynamically? Or actual text content too?
  4. #3
  5. SeoRaptor
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Mar 2016
    Location
    France, Civens
    Posts
    1,233
    Rep Power
    1907
    As far as I know (and could notice from log files) Google only crawls from the US, which can bring a lot of questions about loading speed and especially DNS resolution time VS total loading speed, I'm trying to do some testing on the subject but I don't have significant results at the moment. With Google saying that they want to see websites that load under 1 second with 2-3 seconds being "acceptable" it could soon become an issue. I host my websites in France and when testing speed from France or european countries VS from california I can see a 2 to 2,5 seconds different in total rendering time, the use of a CDN could obviously help but I want to understand what impact it really has because my target audience is based in europe so it doesn't experience that delay. If anyone as some data to provide on the subject I'll be glad to read it.

    Comments on this post

    • JohnAimit agrees : Mostly from USA According to a G spokesperson
    Last edited by Pierre Benneton; Mar 28th, 2018 at 06:33 PM.
    Owner of Bennetonable | AdWords certified - Analytics qualified
    On-Page SEO Cheat Sheet | "My opinions are my own. Feel free to disagree & think above the fold."
  6. #4
  7. Moderator
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Sep 2016
    Location
    United Kingdom
    Posts
    1,374
    Rep Power
    1316
    According to one source:

    • Illinois (46.35%)
    • Arizona (15.68%)
    • Wisconsin (14.95%)
    • Virginia (11.85%)
    • California (11.17%)



    Another source says this:

    (The test was conducted from Paris)

    IPv4 Network Ping Round Trip Location
    66.249.72.2
    92 ms
    USA East Coast ?
    66.249.73.2
    114 ms
    USA Mid West ?
    66.249.74.2
    152 ms
    USA West Coast ?
    66.249.75.2
    96 ms
    USA East Coast ?
    66.249.77.2
    274 ms
    Unknown
    (Not USA nor Europe ?)
    66.249.78.2
    13 ms
    Dublin, Ireland ?

    Article for the above: My Blog: Where is GoogleBot?
    Last edited by matt1966; Mar 29th, 2018 at 08:43 AM.
  8. #5
  9. SeoRaptor
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Mar 2016
    Location
    France, Civens
    Posts
    1,233
    Rep Power
    1907
    Good to see there is at least an IP in Europe ;) I'll have to check about this particular one in my log files to see if I scrapped regularly by it or not.
  10. #6
  11. Super Moderator
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    May 2015
    Location
    United Kingdom
    Posts
    1,580
    Rep Power
    2753
    On topic - majority of the time the crawl is from the US.

    @Pierre, saw this earlier this week. https://twitter.com/willcritchlow/st...77467579822080

    Meaning it's not how quick googlebot downloads the page but actual users.
    Always happy to help in private message. | Learn about my latest project Can You Get Automated Pages To Rank In Google?
    Useful Links: Useful SEO Tools | GTmetrix | FileOptimizer | Cloudflare

Similar Threads

  1. How googlebot crawls the urls in <select> <option>?
    By sviba in forum Google Optimization
    Replies: 2
    Last Post: Nov 22nd, 2007, 07:17 AM
  2. What does googlebot do if crawls site down.
    By Brad123 in forum Google Optimization
    Replies: 2
    Last Post: Jun 12th, 2005, 04:01 PM
  3. Replies: 7
    Last Post: May 26th, 2005, 02:45 PM
  4. Googlebot, Googlebot, wherefore art thou Googlebot
    By GeoffreyF67 in forum Google Optimization
    Replies: 20
    Last Post: Mar 21st, 2005, 07:34 PM
  5. Once Googlebot crawls a site, how long before it's indexed
    By clueless in forum Google Optimization
    Replies: 1
    Last Post: May 18th, 2003, 07:37 PM

IMN logo majestic logo threadwatch logo seochat tools logo