|
|||||||||
|
|||||||||
|
|||||||||
 |
|||||||||
| |
||
|
|
|
|
|||||||||
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
|
|
|
| |||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
SEO Chat Forums Sponsor:
|
|
|
|
#1
August 11th, 2008, 12:03 PM
|
|||
|
|||
|
Duplicate title tags and robots.txt
For some reason googlebot is indexing pages that I've restricted it from going. This is in my robots.txt file:
User-Agent: * Disallow: /misc/ Disallow: /category/ Disallow: /category/cat_page/ Disallow: /misc/contact_us/ Disallow: /*? Disallow: /search/results/ Disallow: /articles/art_page/ Am I doing it right? Basically the URLs im blocking is www.mysite.com/misc/ . I also set the meta tag to 'noindex' for those dir for my domain. Last edited by sharkb8 : August 11th, 2008 at 12:08 PM.
|
|
#2
August 11th, 2008, 12:14 PM
|
||||
|
||||
|
I can't see any reason why that wouldn't work. Have you tried using the robots.txt analysis tool in Google Webmaster Tools?
Also, as you have disallowed /misc/, disallowing /misc/contact_us/ is now redundant.
__________________
... I'll be back for breakfast
New to SEO? SEOChat SEO FAQsForum Rules and Posting Guidelines URL canonicalization code solutions Vigorously pursuing the floccinaucinihilipilification of cheap SEO tricks
|
|
#3
August 11th, 2008, 03:12 PM
|
|||
|
|||
|
Quote:
Yea, I figured that was redundant. I using the anaylzing tool and it everything seems fine. I even submitted directories that I wanted to omit from their search engine. I guess I'll have to wait for results.
|
|
| Viewing: SEO Chat Forums > Google > Google Optimization > Duplicate title tags and robots.txt |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
 |
|
|
|
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
