|
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
| |||||||||
![]() |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
#1
|
|||
|
|||
|
yahoo is indexing nonexistant pages
these pages never existed, and they are the only bot doing this, how can i stop it?
as i catch them on these url's, i add it to robots.txt disallow... but new ones are popping up repeatidly, how can i stop it? |
|
#2
|
||||
|
||||
|
Is your site dynamic?
Y! was doing that with a static site of mine about a month ago. It just suddenly stopped but they reindexed pages that had been removed over 2 years ago. Go figure...
__________________
14th Colony: The hardest working websites online! Looking for links? Join the Union and don't miss English Grammar rules, tips and explanations
|
|
#3
|
|||
|
|||
|
yes it's dynamic, but i have the url's rewritten via mod_rewrite to be static.
what they're indexing somehow gets rewritten and they're redirected to the nearest match of whatever the url is... so it produces a 200/ok response. could i get a duplicate penalty for this? |
![]() |
| Viewing: SEO Chat Forums > Directories > Other Directories > yahoo is indexing nonexistant pages |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
|