|
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
||||
|
||||
|
Scooter Goin' Deep !!!
Starting last night around Midnight (EST), Scooter has crawled over 4,000 pages in my network of 17 sites ... Unique thing is that this is a 3rd level crawl (index.html > sub-index.html > page.html) ...
This is the deepest crawl by Scooter that I have seen in some time ... Anyone else noticing this as well ? |
|
#2
|
|||
|
|||
|
Not in the thousands but it did grab hundred of pages yesterday. Maybe some life for Altavista after all.
|
|
#3
|
||||
|
||||
|
Only grabbed a few pages, not that deep.
__________________
Nintra Directory - Want to become an editor? (Go to category, click submit and click volunteer to edit) |
|
#4
|
|||
|
|||
|
really deep
based on the specifc web site but in extream we are seeing it going 34rd levels DEEP now on some of the site we monitor!
__________________
Link Swapper - a FREE link exchange plug-in and directory add-on for your website Crawler Alert - a FREE service which automatically sends you an email notification whenever a search engine crawler is scanning your website |
|
#5
|
||||
|
||||
|
Now if they would just fix their flakey crawler.
tux:~ # grep "Scooter" accesslog-10-5-2003 | grep " 200 " | grep "Sep" | wc 91188 1094549 10537923 tux:~ # grep "Scooter" accesslog-10-5-2003 | grep " 404 " | grep "Sep" | wc 2127 25524 223795 The 404's are all Scooter screwups, including requests with filled in reffer fields from other 404 results from other sites Cheers,
__________________
theBear |
|
#6
|
||||
|
||||
|
Haven't had any new visits over here :sad:
|
|
#7
|
||||
|
||||
|
No Scooter visits for the last two days although the "Refreshed in past 48 hours" note appears with the AltaVista search results.
|
|
#8
|
|||
|
|||
|
Scooter's been going deep for the last 72 hours. But to what end? Not like I've ever seen a visitor from there.
|
|
#9
|
||||
|
||||
|
I just had a huge update from scooter!
|
|
#10
|
||||
|
||||
|
yep scooters crawled 17000 pages yesterday
i looked at my error log and estimate another 3000 screwups still going this morning (uk) probably won't see any visitors though :sad: |
|
#11
|
||||
|
||||
|
Quote:
Nah, they just love to eat your bandwidth as we all found out! |
|
#12
|
||||
|
||||
|
I've banned the beast!
dirty little bandwidth eater get on yer scooter and feck off!! |
|
#13
|
||||
|
||||
|
Quote:
They will just have to hang around another site now! |
|
#14
|
||||
|
||||
|
40K and Going Strong
Scooter has gone through 40k pages on my site is this a good thing? Will I see traffic from it now?
__________________
-------------------------------------------------- "You miss 100% of the shots you don't take" -------------------------------------------------- Side 2, Inc. | City Info | City Shopping Directory | Sioux City Church |
![]() |
| Viewing: SEO Chat Forums > Search Engines > Search Engines - Classic > Scooter Goin' Deep !!! |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|