- Total Members: 263,695
- Threads: 453,981
- Posts: 1,062,366
Great community. Great ideas.
Welcome to SEOChat, a community dedicated to helping beginners and professionals alike in improving their Search Engine Optimization knowledge. Sign up today to gain access to the combined insight of tens of thousands of members.
-
-
Jan 14th, 2013, 07:11 AM
#1
CDN: how to prevent Google accessing duplicate content?
Little help needed!
Recently I moved static content of my image sharing site to CDN and I am afraid of penalisation for duplicate content, because Google indexed sooner all content on mydomain.com and now it is duplicated on CDN on static.mydomain.com.
Can it be a reason for penalisation for duplicate content? There are just images and HD videos, I don't know if rules on duplicate content apply on this type of content.
Anyway, I need solution to prevent Google from accessing content on my domain a redirect it to CDN subdomain.
HTACCESS I guess?
-
Jan 14th, 2013, 11:20 AM
#2
You should use either one of the two following solutions
1) Robots.txt
If you want both sites to be live, accessible and independent you should use robots.txt to prevent indexing of the newer version of the content. The original indexed content should be visible to search engines and not blocked in robots.txt
2) 301 Redirect (in .htaccess)
If you are just moving the site to a new location and don't need the existing original site to be live then 301 redirect it to the new location.
-
Jan 15th, 2013, 02:36 AM
#3

Originally Posted by
tstolber
You should use either one of the two following solutions
1) Robots.txt
If you want both sites to be live, accessible and independent you should use robots.txt to prevent indexing of the newer version of the content. The original indexed content should be visible to search engines and not blocked in robots.txt
2) 301 Redirect (in .htaccess)
If you are just moving the site to a new location and don't need the existing original site to be live then 301 redirect it to the new location.
Thank you! I managed to find following advices:
First create .htaccess rewrite:
RewriteEngine On
RewriteCond %{HTTP:VIA} ^.*\.worldcdn\..*$
RewriteRule ^robots\.txt$ robots_cdn.txt [L]
And then create robots_cdn.txt:
User-agent: *
Disallow: /
Similar Threads
-
By PromoPens in forum Google Optimization
Replies: 8
Last Post: Nov 10th, 2011, 04:32 AM
-
By samirvohra1980 in forum SEO Help (General Chat)
Replies: 3
Last Post: Jun 30th, 2008, 06:55 AM
-
By AseemKishore in forum Search Engine Optimization
Replies: 3
Last Post: May 20th, 2007, 06:50 AM
-
By KSA in forum Google Optimization
Replies: 2
Last Post: Nov 2nd, 2005, 10:57 PM
-
By MobyKnows in forum Google Optimization
Replies: 6
Last Post: Jun 1st, 2005, 07:42 PM