#1
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2013
    Posts
    2
    Rep Power
    0

    CDN: how to prevent Google accessing duplicate content?


    Little help needed!

    Recently I moved static content of my image sharing site to CDN and I am afraid of penalisation for duplicate content, because Google indexed sooner all content on mydomain.com and now it is duplicated on CDN on static.mydomain.com.

    Can it be a reason for penalisation for duplicate content? There are just images and HD videos, I don't know if rules on duplicate content apply on this type of content.

    Anyway, I need solution to prevent Google from accessing content on my domain a redirect it to CDN subdomain.

    HTACCESS I guess?
  2. #2
  3. SEO Consultant
    SEO Chat Genius (4000 - 4499 posts)

    Join Date
    Jul 2004
    Location
    Minneapolis, MN, USA
    Posts
    4,208
    Rep Power
    979
    You should use either one of the two following solutions

    1) Robots.txt
    If you want both sites to be live, accessible and independent you should use robots.txt to prevent indexing of the newer version of the content. The original indexed content should be visible to search engines and not blocked in robots.txt

    2) 301 Redirect (in .htaccess)
    If you are just moving the site to a new location and don't need the existing original site to be live then 301 redirect it to the new location.
  4. #3
  5. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2013
    Posts
    2
    Rep Power
    0
    Originally Posted by tstolber
    You should use either one of the two following solutions

    1) Robots.txt
    If you want both sites to be live, accessible and independent you should use robots.txt to prevent indexing of the newer version of the content. The original indexed content should be visible to search engines and not blocked in robots.txt

    2) 301 Redirect (in .htaccess)
    If you are just moving the site to a new location and don't need the existing original site to be live then 301 redirect it to the new location.
    Thank you! I managed to find following advices:

    First create .htaccess rewrite:

    RewriteEngine On
    RewriteCond %{HTTP:VIA} ^.*\.worldcdn\..*$
    RewriteRule ^robots\.txt$ robots_cdn.txt [L]

    And then create robots_cdn.txt:

    User-agent: *
    Disallow: /

Similar Threads

  1. Will Google Consider This Duplicate Content?
    By PromoPens in forum Google Optimization
    Replies: 8
    Last Post: Nov 10th, 2011, 05:32 AM
  2. Duplicate content & google
    By samirvohra1980 in forum SEO Help (General Chat)
    Replies: 3
    Last Post: Jun 30th, 2008, 07:55 AM
  3. Does a 301 redirect prevent duplicate content?
    By AseemKishore in forum Search Engine Optimization
    Replies: 3
    Last Post: May 20th, 2007, 07:50 AM
  4. Would Google consider this Duplicate Content?
    By KSA in forum Google Optimization
    Replies: 2
    Last Post: Nov 2nd, 2005, 11:57 PM
  5. How does SEOchat prevent dup content on Google?
    By MobyKnows in forum Google Optimization
    Replies: 6
    Last Post: Jun 1st, 2005, 08:42 PM

IMN logo majestic logo threadwatch logo seochat tools logo