
October 12th, 2007, 05:03 PM
|
|
Registered User
|
|
Join Date: Oct 2007
Posts: 1
Time spent in forums: 14 m 49 sec
Reputation Power: 0
|
|
|
Searchable Job Board - Content Duplication??
We are a recruitment agency. Our website is linked to our vacancy database so that users can browse/search jobs by industry/location/salary etc. We have around 250 individual job listings. I recently created a site map using a 3rd party automatic site map product. It created 267 page listings all with one of two different titles. I'm concerned that our robots.txt file should alert the bots as to how to deal with this section of the site. Our listings contain certain standard text about our company and other vacancies, and each page is automatically created with standard identical tags. Can anyone advise? Should we tell the bots to ignore the listings, or ignore the search page? What's the best way for us to get SEO credit for having a large number of relevant and dynamic pages, without being penalised for duplication of content and/or tags?
|