Alexa Ranking
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat Forums > Search Engine Strategies > Alexa Ranking
Reload this Page

Alexa's spider

Discuss Alexa's spider in the Alexa Ranking forum on SEO Chat.
Alexa's spider Alexa Ranking forum discussing the Alexa Traffic Rankings and its issues. Talk about the Alexa toolbar and AlexaSurf, and discuss the importance of site reach and page views.

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old October 3rd, 2003, 07:31 PM
digitalpoint's Avatar
digitalpoint digitalpoint is offline
Contributing User
SEO Chat Beginner (1000 - 1499 posts)
  
Join Date: Aug 2003
Location: San Diego • USA
Posts: 1,276 digitalpoint User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 21 m 55 sec
Reputation Power: 7
Alexa's spider
I'm curious if anyone knows why Alexa (user agent = ia_archiver) spiders website content? Because when you search on Alexa, it uses Google search results...

Anyone know?

- Shawn
Reply With Quote
  #2  
Old October 4th, 2003, 12:58 AM
sawan sawan is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Oct 2003
Posts: 40 sawan User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 5
Send a message via AIM to sawan Send a message via Yahoo to sawan
i think alexa does scroll the content,

you can see this by search result of
http://www.alexa.com/search?q=website+designing

and

http://www.google.com/search?source...bsite+designing
Reply With Quote
  #3  
Old October 5th, 2003, 10:42 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
It is crawling for the archive.org.
__________________

Nintra Directory - Want to become an editor? (Go to category, click submit and click volunteer to edit)
Reply With Quote
  #4  
Old October 6th, 2003, 02:02 AM
sawan sawan is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Oct 2003
Posts: 40 sawan User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 5
Send a message via AIM to sawan Send a message via Yahoo to sawan
ur right matrix
Reply With Quote
  #5  
Old October 8th, 2003, 08:18 AM
BroadProspect BroadProspect is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Oct 2003
Location: Israel
Posts: 411 BroadProspect User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 5 h 23 m 50 sec
Reputation Power: 5
archive
as a matter of fact they are offering they "internet history" archive for sale !
__________________
Link Swapper - a FREE link exchange plug-in and directory add-on for your website

Crawler Alert - a FREE service which automatically sends you an email notification whenever a search engine crawler is scanning your website
Reply With Quote
  #6  
Old October 8th, 2003, 09:47 AM
Bernard's Avatar
Bernard Bernard is offline
Supercalifragilistic
SEO Chat Beginner (1000 - 1499 posts)
  
Join Date: May 2003
Location: Friendswood, TX
Posts: 1,020 Bernard User rank is Corporal (100 - 500 Reputation Level)Bernard User rank is Corporal (100 - 500 Reputation Level)Bernard User rank is Corporal (100 - 500 Reputation Level)Bernard User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 5 Days 15 h 52 m 56 sec
Reputation Power: 8
It may also be spidering to capture an image of the home page for their thumbnail pics on the top 3 listings of a SERP.
__________________
Have a thumb? Check out my gardening forum.
Reply With Quote
  #7  
Old January 10th, 2004, 07:48 AM
john854 john854 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Nov 2003
Posts: 113 john854 User rank is Private First Class (20 - 50 Reputation Level)john854 User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 h 9 sec
Reputation Power: 5
I also would like to know why Alexa Crawls site's!!

I get the Alexa robot crawling my site every other day, sometimes daily which is more than Google.

They don't just crawl one page, they crawl the whole site and they also use alot of my bandwith!

When I go to the Alexa Website to see details about my site. I see that most of my sites information is well outdated.

The screenshot image that they are using is the screen shot of my site when it was in the early sages. The information on the amount of sites that link to my site has also not changed for a long time, even when I have been exchanging links with alot of other sites.

My question is, why do they crawl my site and probably other sites on the Web every other day or even daily?
__________________
Affiliate Programs Directory - Over 2,000 Programs - Contextual Ads, CPM Popunders, plus more
-----> 140+ CPA Affiliate Networks - lists some of the top networks online.
Reply With Quote
  #8  
Old January 10th, 2004, 06:45 PM
requiem requiem is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Oct 2003
Posts: 532 requiem User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 12 m 59 sec
Reputation Power: 5
Quote:
Originally posted by Matrix28
It is crawling for the archive.org.


Right on
Reply With Quote
  #9  
Old January 11th, 2004, 06:17 AM
john854 john854 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Nov 2003
Posts: 113 john854 User rank is Private First Class (20 - 50 Reputation Level)john854 User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 h 9 sec
Reputation Power: 5
So your telling me that it crawls my site every day just to find the archive.org.

But what is the archive.org and why do they need to crawl for it?
Last edited by john854 : January 11th, 2004 at 04:29 PM.
Reply With Quote
  #10  
Old January 11th, 2004, 03:05 PM
requiem requiem is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Oct 2003
Posts: 532 requiem User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 12 m 59 sec
Reputation Power: 5
Quote:
Originally posted by john854
So your telling me that it crawls my site every day just to find the crawl for the archive.org.

But what is the archive.org and why do they need to crawl for it?



http://www.archive.org/

The way back engine is a great resource.
Reply With Quote
  #11  
Old January 11th, 2004, 04:35 PM
john854 john854 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Nov 2003
Posts: 113 john854 User rank is Private First Class (20 - 50 Reputation Level)john854 User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 h 9 sec
Reputation Power: 5
So the archive.org is the Way Back Machine then.

My thoughts on the Way Back Machine!

I don't find the Way Back Machine all the good because my old site that they have collected are pulling some of the images from my new site.

This makes my old site look different and more rubbish to what it actually was!
Reply With Quote
  #12  
Old January 11th, 2004, 07:47 PM
requiem requiem is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
  
Join Date: Oct 2003
Posts: 532 requiem User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 12 m 59 sec
Reputation Power: 5
Quote:
Originally posted by john854
So the archive.org is the Way Back Machine then.

My thoughts on the Way Back Machine!

I don't find the Way Back Machine all the good because my old site that they have collected are pulling some of the images from my new site.

This makes my old site look different and more rubbish to what it actually was!


Yes, very few people actully brose old sites. But it is very important for proving ownership of copyrighted material, and what previously owned domains have been used for in the past.
Reply With Quote
  #13  
Old January 12th, 2004, 01:36 PM
john854 john854 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Nov 2003
Posts: 113 john854 User rank is Private First Class (20 - 50 Reputation Level)john854 User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 4 h 9 sec
Reputation Power: 5
Yeah, I guess your right. I also guess that , thats one good use for having it!
Reply With Quote
Reply

Viewing: SEO Chat Forums > Search Engine Strategies > Alexa Ranking > Alexa's spider

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support |