Search Engines - Classic
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch EnginesSearch Engines - Classic

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old September 10th, 2003, 02:05 AM
clueless's Avatar
clueless clueless is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: May 2003
Posts: 77 clueless User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Scooter Goin' Deep !!!

Starting last night around Midnight (EST), Scooter has crawled over 4,000 pages in my network of 17 sites ... Unique thing is that this is a 3rd level crawl (index.html > sub-index.html > page.html) ...

This is the deepest crawl by Scooter that I have seen in some time ... Anyone else noticing this as well ?

Reply With Quote
  #2  
Old September 11th, 2003, 12:11 PM
LilOptimizer LilOptimizer is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jul 2003
Posts: 836 LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 6 Days 1 h 59 m 35 sec
Reputation Power: 7
Thumbs up

Not in the thousands but it did grab hundred of pages yesterday. Maybe some life for Altavista after all.
__________________
SootleDir - When only the finest link will do | Webmaster Forum |

Reply With Quote
  #3  
Old October 5th, 2003, 07:52 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
Only grabbed a few pages, not that deep.
__________________

Nintra Directory - Want to become an editor? (Go to category, click submit and click volunteer to edit)

Reply With Quote
  #4  
Old October 8th, 2003, 08:49 AM
BroadProspect BroadProspect is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Oct 2003
Location: Israel
Posts: 411 BroadProspect User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 5 h 23 m 50 sec
Reputation Power: 6
really deep

based on the specifc web site but in extream we are seeing it going 34rd levels DEEP now on some of the site we monitor!
__________________
Link Swapper - a FREE link exchange plug-in and directory add-on for your website

Crawler Alert - a FREE service which automatically sends you an email notification whenever a search engine crawler is scanning your website

Reply With Quote
  #5  
Old October 10th, 2003, 09:29 PM
theBear's Avatar
theBear theBear is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Mar 2003
Location: Maine USA
Posts: 524 theBear User rank is Private First Class (20 - 50 Reputation Level)theBear User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 25 m 38 sec
Reputation Power: 6
Send a message via AIM to theBear
Now if they would just fix their flakey crawler.

tux:~ # grep "Scooter" accesslog-10-5-2003 | grep " 200 " | grep "Sep" | wc
91188 1094549 10537923
tux:~ # grep "Scooter" accesslog-10-5-2003 | grep " 404 " | grep "Sep" | wc
2127 25524 223795

The 404's are all Scooter screwups, including requests with filled in reffer fields from other 404 results from other sites .

Cheers,
__________________
theBear

Reply With Quote
  #6  
Old October 11th, 2003, 05:07 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
Haven't had any new visits over here :sad:

Reply With Quote
  #7  
Old October 11th, 2003, 10:55 PM
WhiteGyr's Avatar
WhiteGyr WhiteGyr is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Location: Idaho USA
Posts: 158 WhiteGyr User rank is Private First Class (20 - 50 Reputation Level)WhiteGyr User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 2 Days 20 h 11 m 36 sec
Reputation Power: 6
Send a message via ICQ to WhiteGyr Send a message via AIM to WhiteGyr Send a message via MSN to WhiteGyr Send a message via Yahoo to WhiteGyr
No Scooter visits for the last two days although the "Refreshed in past 48 hours" note appears with the AltaVista search results.

Reply With Quote
  #8  
Old October 25th, 2003, 07:12 AM
LilOptimizer LilOptimizer is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jul 2003
Posts: 836 LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level)LilOptimizer User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 6 Days 1 h 59 m 35 sec
Reputation Power: 7
Talking

Scooter's been going deep for the last 72 hours. But to what end? Not like I've ever seen a visitor from there.

Reply With Quote
  #9  
Old October 25th, 2003, 09:31 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
I just had a huge update from scooter!

Reply With Quote
  #10  
Old October 27th, 2003, 08:50 AM
multimedia's Avatar
multimedia multimedia is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jun 2003
Location: online of course
Posts: 49 multimedia User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 30 sec
Reputation Power: 6
yep scooters crawled 17000 pages yesterday
i looked at my error log and estimate another 3000 screwups
still going this morning (uk)

probably won't see any visitors though :sad:

Reply With Quote
  #11  
Old October 27th, 2003, 11:47 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
Quote:
Originally posted by multimedia
yep scooters crawled 17000 pages yesterday
i looked at my error log and estimate another 3000 screwups
still going this morning (uk)

probably won't see any visitors though :sad:

Nah, they just love to eat your bandwidth as we all found out!

Reply With Quote
  #12  
Old October 27th, 2003, 08:56 PM
multimedia's Avatar
multimedia multimedia is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jun 2003
Location: online of course
Posts: 49 multimedia User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 30 sec
Reputation Power: 6
I've banned the beast!
dirty little bandwidth eater

get on yer scooter and feck off!!

Reply With Quote
  #13  
Old October 28th, 2003, 03:01 AM
Matrix28's Avatar
Matrix28 Matrix28 is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2003
Posts: 341 Matrix28 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 h 37 m 13 sec
Reputation Power: 6
Quote:
Originally posted by multimedia
I've banned the beast!
dirty little bandwidth eater

get on yer scooter and feck off!!

They will just have to hang around another site now!

Reply With Quote
  #14  
Old October 31st, 2003, 12:11 PM
sraloff's Avatar
sraloff sraloff is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jul 2003
Location: Sioux City, IA
Posts: 121 sraloff User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 3 h 37 m 47 sec
Reputation Power: 6
Send a message via MSN to sraloff Send a message via Yahoo to sraloff
40K and Going Strong

Scooter has gone through 40k pages on my site is this a good thing? Will I see traffic from it now?
__________________
--------------------------------------------------
"You miss 100% of the shots you don't take"
--------------------------------------------------
Side 2, Inc. | City Info | City Shopping Directory | Sioux City Church

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch EnginesSearch Engines - Classic > Scooter Goin' Deep !!!


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support |