Search Engines - Classic
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat Forums > Search Engines > Search Engines - Classic
Reload this Page

Is this spider anygood?

Discuss Is this spider anygood? in the Search Engines - Classic forum on SEO Chat.
Is this spider anygood? Classic Search Engines forums discussing search engines of the past. There has been a lot of search engine consolidation. Overture bought AltaVista. Yahoo bought Inktomi and Overture. Here is where we can discuss the old times in SEO.

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old April 1st, 2003, 03:37 AM
eurobabes eurobabes is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Mar 2003
Posts: 86 eurobabes User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Is this spider anygood?
crawl16-public.alexa.com
I am getting crawled all over by this spider, what is this www.alexa.com and is this spider anygood
Reply With Quote
  #2  
Old April 1st, 2003, 09:12 AM
Darrin Ward's Avatar
Darrin Ward Darrin Ward is offline
Founder, SEOChat.com :)
SEO Chat Beginner (1000 - 1499 posts)
  
Join Date: Dec 2002
Location: Miami, Florida
Posts: 1,439 Darrin Ward User rank is Corporal (100 - 500 Reputation Level)Darrin Ward User rank is Corporal (100 - 500 Reputation Level)Darrin Ward User rank is Corporal (100 - 500 Reputation Level)Darrin Ward User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 17 h 5 m 20 sec
Reputation Power: 11
Yeah it's a good crawler. If you want your site to be in Alexa then don't be worried!

On that note, SeoChat.com is up to an Alexa Rank of 10,882 and Google-Dane.com is up to 2706 - So keep using those Alexa Toolbars whilst suring the sites!

Resource:
Download Alexa Toolbar
__________________
Darrin J. Ward, a Professional SEO Consultant and Original Founder of SEO Chat (this site), Google Dance Tool & some other cool stuff!

* Rankings Reporter - Track your Website's Keyword Rankings in Google & Yahoo.

* ChatButton - Free AJAX Chatboxes to embed onto any Webpage - super-easy copy/paste setup!.
Reply With Quote
  #3  
Old April 1st, 2003, 01:35 PM
theBear's Avatar
theBear theBear is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Mar 2003
Location: Maine USA
Posts: 524 theBear User rank is Private First Class (20 - 50 Reputation Level)theBear User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 25 m 38 sec
Reputation Power: 6
Send a message via AIM to theBear
Quote:
Originally posted by "Darrin Ward"

Yeah it's a good crawler. If you want your site to be in Alexa then don't be worried!

On that note, SeoChat.com is up to an Alexa Rank of 10,882 and Google-Dane.com is up to 2706 - So keep using those Alexa Toolbars whilst suring the sites!

Resource:
Download Alexa Toolbar


It also is a pain in the butt, if you visit a site with the bar installed the bot does follow shortly, this means that if you don't want a site indexed best you have a robots.txt file installed to prevent it from being indexed.

Had a client site up just for remote content editing, the person doing the editing had the bar installed on her home computer within one day Alexa was there trying to crawl the site.

Cheers,
__________________
theBear
Reply With Quote
  #4  
Old April 2nd, 2003, 03:37 AM
stuijts's Avatar
stuijts stuijts is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Mar 2003
Location: Kerken, Germany
Posts: 115 stuijts User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 m 10 sec
Reputation Power: 6
Does the Alexa Toolbar make sense for foreign sites? (at least not regarding the Amazon-Programm)

Should we now install toolbars of each SE??? ;-)
__________________
Birthe
Reply With Quote
  #5  
Old April 2nd, 2003, 04:07 PM
theBear's Avatar
theBear theBear is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Mar 2003
Location: Maine USA
Posts: 524 theBear User rank is Private First Class (20 - 50 Reputation Level)theBear User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 25 m 38 sec
Reputation Power: 6
Send a message via AIM to theBear
Quote:
Originally posted by "stuijts"

Does the Alexa Toolbar make sense for foreign sites? (at least not regarding the Amazon-Programm)

Should we now install toolbars of each SE??? ;-)


If you are an Amazon Affiliate there is now a special Alexa bot that you must allow to have access to your site. As for the big Alexa bot ia_archiver I reported a problem to them last year that they have since fixed, however I noticed several new glitches a couple of months ago and banned it from a couple of large sites. Load was a bit too heavy.

I only have the Google toolbar installed on the *doze side of this system. I hate *doze so spend very little time over there. *nix spoken here.

A number of browser toolbars are actually parisites.

Cheers,
Reply With Quote
  #6  
Old April 2nd, 2003, 04:44 PM
Marcel Marcel is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Apr 2003
Posts: 128 Marcel User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Send a message via ICQ to Marcel
Quote:
Originally posted by "theBear"

A number of browser toolbars are actually parisites.

Cheers,


Most of them, actually.
Reply With Quote
  #7  
Old April 2nd, 2003, 04:58 PM
theBear's Avatar
theBear theBear is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Mar 2003
Location: Maine USA
Posts: 524 theBear User rank is Private First Class (20 - 50 Reputation Level)theBear User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 25 m 38 sec
Reputation Power: 6
Send a message via AIM to theBear
Quote:
Originally posted by "Marcel"

Quote:
Originally Posted by theBear
A number of browser toolbars are actually parisites.

Cheers,


Most of them, actually.



Yep ... that is why I don't use *doze or Internet Kaboom except for the Google toolbar ... always use another browser.

Cheers,
Reply With Quote
Reply

Viewing: SEO Chat Forums > Search Engines > Search Engines - Classic > Is this spider anygood?

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 3 hosted by Hostway. 
Stay green...Green IT