Discuss Alexa's spider in the Alexa Ranking forum on SEO Chat. Alexa's spider Alexa Ranking forum discussing the Alexa Traffic Rankings and its issues. Talk about the Alexa toolbar and AlexaSurf, and discuss the importance of site reach and page views.
BuySellLinks.com is a new Text Link Advertising Brokerage by the founder of LinkAdage that offers high-end text links and a premier membership base. We screen all advertisers and publishers and their web pages to make sure we are offering a service that works for everyone. Our plug-in is super easy to install but if you are hands off, w e offer free installation.
Tired of dealing with shady text link buyers and/or sellers? Try BuySellLinks.
Receive the tools necessary to be the rock star of your field. Our 12-month program teaches you the evolving world of multi-channel marketing as well as the complex issues and opportunities found in the industry.
Posts: 1,276
Time spent in forums: 1 h 21 m 55 sec
Reputation Power: 10
Alexa's spider
I'm curious if anyone knows why Alexa (user agent = ia_archiver) spiders website content? Because when you search on Alexa, it uses Google search results...
Posts: 146
Time spent in forums: 7 h 50 m 52 sec
Reputation Power: 0
I also would like to know why Alexa Crawls site's!!
I get the Alexa robot crawling my site every other day, sometimes daily which is more than Google.
They don't just crawl one page, they crawl the whole site and they also use alot of my bandwith!
When I go to the Alexa Website to see details about my site. I see that most of my sites information is well outdated.
The screenshot image that they are using is the screen shot of my site when it was in the early sages. The information on the amount of sites that link to my site has also not changed for a long time, even when I have been exchanging links with alot of other sites.
My question is, why do they crawl my site and probably other sites on the Web every other day or even daily?
Posts: 532
Time spent in forums: 12 m 59 sec
Reputation Power: 9
Quote:
Originally posted by john854 So the archive.org is the Way Back Machine then.
My thoughts on the Way Back Machine!
I don't find the Way Back Machine all the good because my old site that they have collected are pulling some of the images from my new site.
This makes my old site look different and more rubbish to what it actually was!
Yes, very few people actully brose old sites. But it is very important for proving ownership of copyrighted material, and what previously owned domains have been used for in the past.