Page 1 of 2 12 Last
  • Jump to page:
    #1
  1. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2005
    Posts
    76
    Rep Power
    15

    Talking Removing Duplicate Content - The best way


    Hi my site I think has a slight google penalty on it, mainly due to content that i was given by online sportsbooks to add to my site.

    I added the content given to me on new pages - with new title tags, description, meta tags etc, however the content paragraph on the page is the same as other sites.

    I really want to get rid of this content, but as I have some 100 pages I want to change it will be very time consuming. All the pages have a PR of around 3

    I was wondering what the best way to go about this -

    Could I use the robots.txt file to stop google indexing certain pages of my site - therefore eliminating the possible 'duplicate penalty' i may have recieved?

    Or do I just have to go through each page of the site and change everything, run it through copyscape until there is no duplicate content left??

    Any help would be appreciated!
  2. #2
  3. Super Moderator
    SEO Chat Super Hero (2500 - 2999 posts)

    Join Date
    Aug 2003
    Location
    Vancouver, Washington, U.S.A.
    Posts
    2,578
    Rep Power
    669
    1. one paragraph on a page does not equal duplicate content.
    If it is the only content on the page, it may have been dampened as the site where the content is found first will receive more weight. Duplicate content is not as much of a problem as you might think.

    2. Yes you can use a robots.txt to prevent google from spidering certain pages.
    User-agent: googlebot
    Disallow: /whateverpage.html

    3. disallowing indexing will eventually cause those pages to lose pr, and they wont be used at all in ranking your site. The bots you disallow will simply ignore them all together.

    4. My suggestion, just change a few sentences. If you can get around a 20% difference from the other site, the duplicate content dampening should go away.

    5. 20% is an arbitrary number that works for me, it may be less.
    Work Smarter, Not Harder
  4. #3
  5. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2005
    Posts
    76
    Rep Power
    15
    Thanks for that reply.

    When I run one of the said webpages through copyscape, I can see the paragraph appear on more than ten results.

    Ur right, my pages are not complete copies as they have their own navigation, meta tags etc.

    I think I'll try and change a few sentences here and there as suggested.

    I was going to use robots.txt but after what you say, I dont think I will.

    Anyone else got any views?
  6. #4
  7. Permanently Banned
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Feb 2004
    Posts
    1,935
    Rep Power
    23
    for some people (like googler i'm assuming) duplicate content is not a problem. but as of late (within the last 1-2 months), it seems G has sharpened it's duplicate content eye and has been applying these filters much more heavily to new sites.

    right now almost 80% of our company's new sites (that all have the same structure as our older sites) are getting spanked for Dupe content (but not our older sites). it's a problem we've addressed several times within the last few weeks, and affects almost all of our sites in one way or another.

    simply changing a paragraph or two has not helped in our case and all of our content is unique anyway. some of our templates need to be re-structured in CSS to 'hide' most of the code. that way there isn't an overwhelming amount of code overpowering the little content.

    we have also added 'nofollow' tags to many of the potentially duplicate pages, until we get a chance to add new content.

    we have also added dynamic content in the form of 'random text' and also rss feeds, to keep certain elements unique.

    it's a terrible struggle we're facing right now as the DUPE filter seems to be stronger than ever on NEW sites...
    It's been fun everyone... Time to leave for good. See this for more details.
  8. #5
  9. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2005
    Posts
    76
    Rep Power
    15
    My site is nearly four years old and still ranks very well.

    We are still on the first page (20m results) but not at the top, as we were for three years.

    As i said, i think we have been given a slight penalty as we do have this annoying dup content - I think Im going to have to go through page by page until it is all gone

    I think this as when I type this into google "www.mysite.com" (in inverted commas) our site appears on page two and not at the top. When I do the same for our competitors who rank above us, they all come out first.

    So, I think I have narrowed it down to this slight dup. content filter, as that is the only thing I can see that would appear to be affecting us. We have more backlinks than all our competitors and rank #2 for all in anchor.
  10. #6
  11. Permanently Banned
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Feb 2004
    Posts
    1,935
    Rep Power
    23
    hmm.. that doesn't sound like a dupe filter then... a dupe filter is generally seen when you do a site:www.mysite.com command and URL only listings appear instead of the pages with their full descriptions.

    when you don't rank #1 for "www.mysite.com" (with the quotes) that usually indicates SANDBOX ... (for newer sites), but since your site is so old it probably means a big SLAP. this has happened to one of my 3 year old sites because (i believe) it was finally labeled as a 'thin affiliate' with little or no 'value-added' to the user. it always ranked well (along with #1 for "www.mysite.com") but after the filter was slapped on, it was only found on the 2nd page for "www.mysite.com" ...

    something to think about.
  12. #7
  13. Super Moderator
    SEO Chat Super Hero (2500 - 2999 posts)

    Join Date
    Aug 2003
    Location
    Vancouver, Washington, U.S.A.
    Posts
    2,578
    Rep Power
    669
    Originally Posted by toddieg
    hmm.. that doesn't sound like a dupe filter then... a dupe filter is generally seen when you do a site:www.mysite.com command and URL only listings appear instead of the pages with their full descriptions.
    Really? I did not know that, thanks!

    While we are on the subject, I've had this question about PDF's, sometimes people who we resell products for provide us with their spec sheets, whitepapers etc in PDF form. I put them on the site but they are essentially duplicates of whats on another persons site and probobaly several others. Not that pdf's rank well anyway, but does anyone know of the same rules apply with other documents as they do with standard web content?
    Last edited by googler; Sep 7th, 2005 at 12:29 PM.
  14. #8
  15. Permanently Banned
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Feb 2004
    Posts
    1,935
    Rep Power
    23
    hmm.. good question. not sure about PDF's ... some of them actually rank really well though.
  16. #9
  17. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2005
    Posts
    76
    Rep Power
    15
    Thanks for the replies guys, you really got me thinking.

    mmm, thats interesting toddieg. I didnt know that either.

    I have to admit I did find it strange as when ran a few of my competitors pages through copyscape they also had over 10 results for duplicate content. As I said, even though we used this editorial content, we did have unique title's description, keyword tags for each page. Doing a site:www.mysite.com does show our site with all their descriptions.

    Perhaps it is something other than a duplicate content filter. My site is an affiliate site, but Im doing exactly the same as my competitors so I would be annoyed if if I was given a 'slap' because of this. I think I should counter with an uppercut!

    We did do some pretty strong one way linking around four months ago, and I have been trying harder than normal to get more inbounds. Perhaps I have been trying too hard

    I know that too many inbounds in short space of time could trigger a filter of some sort.

    What would you suggest? I was being pretty proactive on the link building front, and it's quite possible I may have triggered a small sandbox effect - perhaps I should stop obtaining links for a month or two?

    Mmm. Anyone else got any thoughts??
  18. #10
  19. Permanently Banned
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Feb 2004
    Posts
    1,935
    Rep Power
    23
    i'm VERY confident now (that you mentioned it's an affiliate site) that you were slapped strictly because of that. sure your competition might not be slapped, but the same thing happend to me (with my affiliate site)

    maybe if you post the URL (or PM it to me) i can have a quick look.

    the KEY to having affiliate sites not get spanked is QUALITY CONTENT, UNIQUE CONTENT and VALUE ADDED to the user.

    examples of this can be
    -a price comparison tool
    -customer reviews for each product
    -a product rating system (and/or detailed information on the product)
  20. #11
  21. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2005
    Posts
    76
    Rep Power
    15
    Hi! i sent you a PM toddieg!
  22. #12
  23. Permanently Banned
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Feb 2004
    Posts
    1,935
    Rep Power
    23
    got your PM.. here's a good link for everyone to read... it's google's spam guide for their quality control team.

    http://www.searchbistro.com/spamguide.doc

    Comments on this post

    • googler agrees : great resource, thanks for giving us something that we can use.
  24. #13
  25. Super Moderator
    SEO Chat Super Hero (2500 - 2999 posts)

    Join Date
    Aug 2003
    Location
    Vancouver, Washington, U.S.A.
    Posts
    2,578
    Rep Power
    669
    Originally Posted by toddieg
    got your PM.. here's a good link for everyone to read... it's google's spam guide for their quality control team.

    http://www.searchbistro.com/spamguide.doc
    funny, some of the sites mentioned are still using the techniques that they are the example of "spam" and they still have PR and rankings, even though they are in the quality control guide for spam. Not banned.
  26. #14
  27. SEO Earthquake!
    SEO Chat Scholar (3000 - 3499 posts)

    Join Date
    Jun 2005
    Location
    Sacramento, CA
    Posts
    3,307
    Rep Power
    25
    Originally Posted by Sniffer1
    I know that too many inbounds in short space of time could trigger a filter of some sort.
    Maybe not: http://forums.seochat.com/t48762/s.html
  28. #15
  29. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2005
    Posts
    8
    Rep Power
    0
    toddieg

    Can you answer one question...

    If I place articles on my webpage with links to website I took them... will Google count the content on MY webpage as dublicate content?

    The article will look like that:

    Title blah-bla-bla taken from http://bla-bla-bla TEXT
Page 1 of 2 12 Last
  • Jump to page:

Similar Threads

  1. Replies: 4
    Last Post: May 20th, 2005, 02:33 AM
  2. Duplicate Content Penalty!!!
    By seopt741 in forum Google Optimization
    Replies: 3
    Last Post: Jan 20th, 2005, 10:15 PM
  3. What is the best way to identify and remove duplicate content?
    By budbiss in forum Google Optimization
    Replies: 8
    Last Post: Jan 11th, 2005, 07:08 PM
  4. Duplicate content and PR? any way out?
    By Scott.G in forum Google Optimization
    Replies: 7
    Last Post: Jun 30th, 2004, 12:10 PM
  5. Duplicate Content Penalty and SubDomains
    By mukthi in forum Google Optimization
    Replies: 10
    Last Post: Oct 18th, 2003, 11:56 AM

IMN logo majestic logo threadwatch logo seochat tools logo