Welcome to SEOChat, a community dedicated to helping beginners and professionals alike in improving their Search Engine Optimization knowledge. Sign up today to gain access to the combined insight of tens of thousands of members.
Registered User
BSpider is visting with ip address 129.33.201.12. When i checked at 129.33.201.12 IP Address WHOIS | DomainTools.com , It refers to ibm server, i did a traceroute and it led to AT & T.
whose bot is this. It is crawling everything webpage, css, image files many no of times within 1 minute.
SEO Consultant
You can use robots.txt and .htaccess to prevent it from crawling things you don't want. There are some bandwidth hoggin bots out there that need to be tamed sometimes.
Become Part of This Conversation
Join NowFor Free!
DevSEOChat A poster at #SEOChat needs some help with a 301 #redirect - any #SEOs want to lend a hand? #DevSEOChat http://t.co/frBrtqWfGaDevSEOChat A poster at SEO Chat needs some help with a 301 redirect - any SEOs want to lend a hand? http://t.co/xE6O18UcjHDevSEOChat Great post from @Seosmarty at #SEOChat #DevSEOChat How to Take Part In a #Twitter Chat http://t.co/RhPgwvG6SdDevSEOChat How to Take Part In a Twitter Chat http://t.co/pYWzYkzRtt http://t.co/F08l8hOKlODevSEOChat An #SEOChat forum member is earning very little money from #Google #Adsense - what gives? #SEO #DevSEOChat http://t.co/BBGkHXKhSR
