Science & Technology Network

SEO Chat Forums Sponsor:

October 5th, 2006, 11:17 PM

wildernessD

Contributing User

Join Date: Aug 2006

Posts: 61

Time spent in forums: 3 h 28 m 9 sec
Reputation Power: 3

Science & Technology Network

Shanghai,China

Enterd in the wee hours of the morning and returned later that night to 403 after Class One was added to denies.
94 pages one one site and 82 on the other.
The inital crawled/harvested pages would have been a lot higher with efficient software.
The bot hit some pages 3-4 times at different intervals.
Made the case errors that many of these new bots seem to have.

122.0.154.165 - - [05/Oct/2006:01:51:40 -0700] "GET /myfolder/mypage.htm/ HTTP/1.1" 200 40353 "-" "Mozilla/4.0(compatible; MSIE 5.0; Windows 98; DigExt)"

122.0.155.70 - - [05/Oct/2006:17:29:48 -0700] "GET / HTTP/1.1" 403 - "-" "Mozilla/4.0(compatible; MSIE 5.0; Windows 98; DigExt)"

Viewing: SEO Chat Forums > Search Engine Strategies > Search Engine Spiders > Science & Technology Network

« Previous Thread | Next Thread »

Thread Tools	Search this Thread
Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts vB code is On Smilies are On [IMG] code is On HTML code is Off

View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox

Forum Jump

Free IT White Papers!

How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.
Request Your Free Technology Downloads!

Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.
Request Your Free Technology Downloads!

Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.
Request Your Free Technology Downloads!

Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.
Request Your Free Technology Downloads!

Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.
Request Your Free Technology Downloads!

More Free IT White Papers!