1. No Profile Picture
    Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Nov 2005
    Rep Power

    Url rewrite, duplicate content, robots.txt

    Because I am on a shared server, I could not do a friendly URL rewrite of our website using the usual isapi modules. I used a httphandler and it is working just fine. Google has all of our Products.aspx?PId=1234&CId=12 indexed just fine.

    Now we have updated our google sitemap to show only the new friendly urls and we are being deep crawled and the website only uses the new friendly URLs- but will respond correctly to the old urls. Since the new friendly urls, and the old data-driven urls will show the same content, do we have a duplicate content issue with google?

    Should I use a robots meta tag to block crawling the Products.aspx? pages and also block it in the robots.txt file or?

    We don't want to loose our rankings from our old data-driven Products.aspx? files while Google indexes our new friendly urls.

    I don't think (and no one had an idea how to on this forum) that we can do a 301 on IIS when there are hundreds of calls to the same Products.aspx pages with hundreds of different parameters.


    Last edited by Bill_H; Jun 24th, 2006 at 07:02 AM.

Similar Threads

  1. Duplicate content??
    By bnkhill11 in forum Google Optimization
    Replies: 5
    Last Post: Jan 31st, 2006, 07:19 AM
  2. Duplicate Content on different web sites
    By SEOgreenhorn in forum Google Optimization
    Replies: 20
    Last Post: Sep 1st, 2005, 06:50 PM
  3. Duplicate content concerns - experts opinions needed.
    By financialhost in forum Search Engine Optimization
    Replies: 0
    Last Post: May 16th, 2005, 09:11 AM
  4. Avoiding a Duplicate Content Situation
    By ledfish in forum Google Optimization
    Replies: 2
    Last Post: Apr 15th, 2005, 12:42 AM
  5. Result of a Google test.
    By Nintendo in forum Google Optimization
    Replies: 10
    Last Post: Aug 31st, 2004, 09:19 AM

IMN logo majestic logo threadwatch logo seochat tools logo