HTML Coding
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsOtherHTML Coding

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old April 2nd, 2003, 09:14 PM
Marcel Marcel is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Apr 2003
Posts: 128 Marcel User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Send a message via ICQ to Marcel
Checking for robots?

How often do you people look at your logs for robost in general and googlebot in particular? Is there any idea to check them logs very often?

Also, can anyone suggest any nice proggie for looking through and sorting info from the raw server logs? I'd appreciate it if you could point me to some freeware proggie or something.

Reply With Quote
  #2  
Old April 2nd, 2003, 09:47 PM
Phoenix's Avatar
Phoenix Phoenix is offline
Contributing User
SEO Chat Beginner (1000 - 1499 posts)
 
Join Date: Jan 2003
Location: Texas!
Posts: 1,135 Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 9 h 4 m 3 sec
Reputation Power: 8
Send a message via AIM to Phoenix
There is something effective that I have looked at recently. On one of my sites, I do not have a robots.txt file. In order to see the robots that crawled the site that day I look at the error log. Requests for 'robots.txt' all in one page, and include an IP. Yet, its hard to determine what bot it is by looking at the IP. I have a list of googlebot IP's but others not.
Might be helpful.
Darrin has a great program for tracking Googlebot hits on a his site called:
GoogleTrax. You might check into that.

Reply With Quote
  #3  
Old April 3rd, 2003, 06:45 AM
jungleimp jungleimp is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Mar 2003
Location: UK
Posts: 54 jungleimp User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
If the server-ware you are using is Apache then "report magic 2.01" is a great bit of software, it'll let you see what search engine keywords your getting hits for as well! I think its free
__________________
Hail to the King Baby!

Reply With Quote
Reply

Viewing: SEO Chat ForumsOtherHTML Coding > Checking for robots?


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump


Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2008 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway
Stay green...Green IT