October 5th, 2006, 11:17 PM
|
|
Contributing User
|
|
Join Date: Aug 2006
Posts: 61
Time spent in forums: 3 h 28 m 9 sec
Reputation Power: 3
|
|
|
Science & Technology Network
Shanghai,China
Enterd in the wee hours of the morning and returned later that night to 403 after Class One was added to denies.
94 pages one one site and 82 on the other.
The inital crawled/harvested pages would have been a lot higher with efficient software.
The bot hit some pages 3-4 times at different intervals.
Made the case errors that many of these new bots seem to have.
122.0.154.165 - - [05/Oct/2006:01:51:40 -0700] "GET /myfolder/mypage.htm/ HTTP/1.1" 200 40353 "-" "Mozilla/4.0(compatible; MSIE 5.0; Windows 98; DigExt)"
122.0.155.70 - - [05/Oct/2006:17:29:48 -0700] "GET / HTTP/1.1" 403 - "-" "Mozilla/4.0(compatible; MSIE 5.0; Windows 98; DigExt)"
|
SEO Chat Forums Sponsor:
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
