|
|||||||||
|
|||||||||
|
|||||||||
 |
|||||||||
| |
||
|
|
|
|
|||||||||
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
|
|
|
| ||||||||||||||||||||||||||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
SEO Chat Forums Sponsor:
|
|
|
|
#1
May 17th, 2004, 09:30 PM
|
||||
|
||||
|
Look at this weird LOG entry...
This is a sample just now from my log file:
Code:
209.50.239.222 - - [17/May/2004:22:22:28 -0400] "GET /audio/microphones/samson-s12.htm HTTP/1.0" 200 11870 "-" "msnbot/0.11 (+http://search.msn.com/msnbot.htm)" msnbot64113.search.msn.com - - [17/May/2004:22:22:28 -0400] "GET /search/highlight.asp?url=http://www.fm-transmitter.com/audio/microphones/samson-s12.htm&terms=complete_cost_of_radio_station HTTP/1.0" 200 12650 "-" "msnbot/0.11 (+http://search.msn.com/msnbot.htm)" MSN is IP-Spoofing are they not? - because the hit apparently came from localhost, since that's my IP address in the first entry. I know it could not have come from localhost, and certainly not with that USER_AGENT.
__________________
Darrin J. Ward, the Original Founder of SEO Chat (this site), Google Dance Tool & some other cool stuff! Read my: Professional SEO Site or Twitter: @DarrinJWard.
|
|
#2
May 18th, 2004, 04:00 PM
|
||||
|
||||
|
Did that IP address request robots.txt also?
- Shawn
__________________
Free Keyword Ranking & Keyword Suggestion Tool Search Engine Forums where you are paid to be a user Western Union | eBay
|
|
#3
May 18th, 2004, 04:07 PM
|
||||
|
||||
|
No, no request for robots.txt
I just saw something, which may or may not be the problem. The highlight.asp script does fetch url's, which would explain the hit from localhost (doh - completely forgot about it). Now what I can't figure out is why the hit for the file came first - it should have it highlight.asp first if it were to cause this to happen.
|
|
#4
May 18th, 2004, 04:32 PM
|
||||
|
||||
|
Actually it would not come first... Apache writes to the log upon completion of the request, not the start of it. Some web browsers will start requesting images before the main page is done loading, and you see the same thing. Images requested in the HTTP logs before the page they were actually on.
- Shawn
|
|
#5
May 18th, 2004, 04:54 PM
|
||||
|
||||
|
Ahhh - suddenly this has turned from what I thought was something new to an educational thing.
I was not aware that apache logs upon completion of the request - I had assumed it did everything more in "realtime". Thanks DigitalPoint for the reply - this makes a lot more sense now.
|
|
#6
May 18th, 2004, 04:58 PM
|
||||
|
||||
|
No prob... I'm good for something once in awhile.
 - Shawn
|
|
#7
May 18th, 2004, 05:05 PM
|
||||
|
||||
|
Also, FWIW, I can see why Apache would want to log things upon completion. Sometimes the web server starts sending data before it knows how much total is going to be sent (for example dynamic content). In PHP you can use the flush() function to spew out the existing output buffer. Even though you might send more after that.
- Shawn
|
|
#8
May 18th, 2004, 05:37 PM
|
||||
|
||||
|
Sometimes it's the basic things you miss.
Good point - if it did it before it wouldn't really know an exact content length.
|
|
#9
May 18th, 2004, 05:40 PM
|
||||
|
||||
|
Bingo.
- Shawn
|
|
| Viewing: SEO Chat Forums > Search Engines > MSN Search Optimization > Look at this weird LOG entry... |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
|
|
 |
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
