Search Engine Spiders
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch Engine StrategiesSearch Engine Spiders

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
Application developers can seamlessly integrate the Advantage Database install with their application install. Learn the best practices used when setting up silent installs with this seminar.
  #16  
Old September 7th, 2004, 04:37 PM
carterman carterman is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2004
Posts: 133 carterman User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 19 m 17 sec
Reputation Power: 4
Quote:
Originally Posted by serendipitous
http://www.spidertrack.org publishes the IP's of Googlebot as it hits their sites.


Thanks....good link

Reply With Quote
  #17  
Old December 29th, 2004, 08:52 PM
craige's Avatar
craige craige is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2004
Posts: 110 craige User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 1 m 36 sec
Reputation Power: 4
Google owns a few IP ranges, including
  • 64.233.160.0 - 64.233.191.255
  • 64.68.80.0 - 64.68.87.255
  • 66.249.64.0 - 66.249.79.255
  • 216.239.32.0 - 216.239.63.255

Reply With Quote
  #18  
Old August 7th, 2007, 11:06 PM
deepumohan.p deepumohan.p is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2007
Location: Kozhikode
Posts: 5 deepumohan.p User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 15 m 35 sec
Reputation Power: 0
Send a message via Yahoo to deepumohan.p
Talking

Quote:
Originally Posted by georgegg
Nothing at the moment, but the address' will change and then they will be wrong
The address's for 'crawl1.googlebot.com' in April, 2003 were:
216.239.46.22, 216.239.46.23, 216.239.46.24,
216.239.46.25, 216.239.46.26, 216.239.46.27,
216.239.46.28, 216.239.46.29, 216.239.46.30,
216.239.46.1, 216.239.46.2, 216.239.46.3,
216.239.46.4, 216.239.46.5, 216.239.46.6,
216.239.46.7, 216.239.46.8, 216.239.46.9,
216.239.46.10, 216.239.46.11, 216.239.46.12,
216.239.46.13, 216.239.46.14, 216.239.46.15,
216.239.46.16, 216.239.46.17, 216.239.46.18,
216.239.46.19, 216.239.46.20, 216.239.46.21

So just a way to get the current ones.

GeorgeGG




72.14.235.104
This is what I got

Reply With Quote
  #19  
Old August 14th, 2007, 12:19 PM
gward's Avatar
gward gward is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jun 2007
Posts: 63 gward User rank is Private First Class (20 - 50 Reputation Level)gward User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 20 h 41 m 30 sec
Reputation Power: 1
The best way to do it is to allow the ip ranges for all the bots (Yahoo!, MSN, Google, Inktomi) and block everything else. Granted you might not be able to do header checks or use some other web diagnostics tools out there, but I'd rather have that than someone ripping off my content.

Quote:
Google owns a few IP ranges, including
64.233.160.0 - 64.233.191.255
64.68.80.0 - 64.68.87.255
66.249.64.0 - 66.249.79.255
216.239.32.0 - 216.239.63.255

Reply With Quote
  #20  
Old October 2nd, 2007, 06:04 AM
criTix criTix is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Oct 2007
Location: Range of places
Posts: 1 criTix User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 15 m 11 sec
Reputation Power: 0
Question How black is this hat?

Hello people

I am looking for some opinions on how good/bad the following would be:

I run a website that needs to offer hyperlocal style content, aimed at a county. The problem is in order to provide such specific content I need the user to provide a postcode. So when googlebot comes along he spaz's out and cant get in.

I got round that by offering a un-descript 'browse' link that automatically logs in using a default postcode - great. Except really thats not a great way to go.

The long and the short of it is would google care if I use thier ip's (as fragmented as all these lists are) to bypass the 'ask for postcode' part. Its roughly 20 lines of html (one table which has an input some descriptive text - say 150 words and a submit button.)

It would effectively be cloaking this part (as bad a phrase as that is) - but how obvious does it have to be for them to penalise you?

The site is only 2 months old and already has 5-10 bots camping out on it - so I am especially wary!


Cheers In advance

Woody

Reply With Quote
  #21  
Old November 6th, 2007, 02:46 AM
AndrewT AndrewT is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Nov 2007
Posts: 2 AndrewT User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 29 m 46 sec
Reputation Power: 0
Question Do Google IP's vary from country to country?

Does anyone know if Google bots use specific country alloted IP's?

The reason I ask is that I have a site which blocks all international traffic and only allows Australian IP's to view the site.

So do I need to make exceptions for Google and other search engines for that matter?

Also it is interesting to note that the Google Bot that visits this particular Australian site uses 66-249-70-81 not mentioned in any of the lists published here.

Reply With Quote
  #22  
Old November 6th, 2007, 03:01 AM
new_seo's Avatar
new_seo new_seo is offline
Contributing User
SEO Chat Intermediate (1500 - 1999 posts)
 
Join Date: Mar 2007
Location: CHAK DE INDIA
Posts: 1,542 new_seo User rank is Sergeant (500 - 2000 Reputation Level)new_seo User rank is Sergeant (500 - 2000 Reputation Level)new_seo User rank is Sergeant (500 - 2000 Reputation Level)new_seo User rank is Sergeant (500 - 2000 Reputation Level)new_seo User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 1 Month 5 Days 7 h 19 m 38 sec
Reputation Power: 16
Send a message via Google Talk to new_seo
Quote:
Originally Posted by AndrewT
Does anyone know if Google bots use specific country alloted IP's?

The reason I ask is that I have a site which blocks all international traffic and only allows Australian IP's to view the site.

So do I need to make exceptions for Google and other search engines for that matter?

Also it is interesting to note that the Google Bot that visits this particular Australian site uses 66-249-70-81 not mentioned in any of the lists published here.

It's better if you start a new thread.

Reply With Quote
  #23  
Old November 6th, 2007, 04:01 PM
wildernessD wildernessD is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2006
Posts: 61 wildernessD User rank is Private First Class (20 - 50 Reputation Level)wildernessD User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 3 h 28 m 9 sec
Reputation Power: 2
This website stays farily updated:
http://www.iplists.com/

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch Engine StrategiesSearch Engine Spiders > Google IPs


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump

 Free IT White Papers!
 
Accelerating Trading Partner Performance
One in five. That's how many partner transactions have at least one error. That is an amazing statistic, particularly given the extraordinary leaps in innovation across the global supply chain during the past two decades. Download this white paper to learn more.

 
Competing on Analytics
This Tech Analysis is designed to help identify characteristics shared by analytics competitors, and includes information about 32 organizations that have made a commitment to quantitative, fact-based analysis.

 
Cost Effective Scaling with Virtualization and Coyote Point Systems
An overview of the industry trend toward virtualization, how server consolidation has increased the importance of application uptime and the steps being taken to integrate load balancing technology with virtualized servers.

 
Five Checkpoints to Implementing IP Telephony
Implementation planning for IP PBX software and IP telephony has become vital as businesses replace discontinued legacy PBX phone systems. This informative whitepaper outlines five "checkpoints" for any implementation plan that will help make IP communications a successful proposition.

 
Hosted Email Security: Staying Ahead of New Threats
In the last two years, email has become a fierce battleground between the nefarious forces of spam and malware, and the heroes of messaging protection. The spam volumes increased alarmingly every month, bringing clever new forms of phishing and virus propagation attacks.

 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 2 hosted by Hostway