#1
  1. No Profile Picture
    Seb
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2008
    Location
    Montreal
    Posts
    24
    Rep Power
    0

    Should admin pages (terms + c, contact us...) pages be blocked to spiders


    Hi,

    I was wondering if I should disallow access to pages such as contact us, privacy policy... through robots.txt since they don't really help me with my site's theme or should I get them indexed so I comply with G.'s view of what pages should appear on a website ?

    Thanks.

    Seb
  2. #2
  3. Smoke me a kipper...
    SEO Chat Hero (2000 - 2499 posts)

    Join Date
    Aug 2007
    Posts
    2,472
    Rep Power
    77
    I use rel=nofollow on internal links to such pages (except for links from the html sitemap). That way they're not acting as link juice sink, yet Google still has access to them. I don't know whether or not it makes a difference if such pages exist on your site -- it's not something I'm inclined to spend time testing. At least this way I can hedge my bets either way, whilst still making the most of any internal link juice.

    Excluding them via robots.txt won't stop link juice flowing to them.
    ... I'll be back for breakfast
    New to SEO? SEOChat SEO FAQs
    Forum Rules and Posting Guidelines
    URL canonicalization code solutions
    Vigorously pursuing the floccinaucinihilipilification of cheap SEO tricks
  4. #3
  5. No Profile Picture
    Seb
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2008
    Location
    Montreal
    Posts
    24
    Rep Power
    0
    Originally Posted by JagNet
    I use rel=nofollow on internal links to such pages (except for links from the html sitemap). That way they're not acting as link juice sink, yet Google still has access to them. I don't know whether or not it makes a difference if such pages exist on your site -- it's not something I'm inclined to spend time testing. At least this way I can hedge my bets either way, whilst still making the most of any internal link juice.

    Excluding them via robots.txt won't stop link juice flowing to them.
    Seems to make good sense, would you mind explaining a little more as I'm not familiar with rel=nofollow ?

    Thanks.

    Seb
    Last edited by Seb; Oct 1st, 2008 at 03:58 AM.
  6. #4
  7. Smoke me a kipper...
    SEO Chat Hero (2000 - 2499 posts)

    Join Date
    Aug 2007
    Posts
    2,472
    Rep Power
    77
    nofollow is added to the "rel" attribute for any links (internal and external) that you don't want to count as a "vote" for the linked page. To quote Google, such links are "taken out of the link equation".
    Code:
    <a href="page.html" rel="nofollow">Anchor text</a>
    The rel attribute is an existing attribute so it won't affect W3C validation, and much like other attributes such as "class" can contain more than one value, eg rel="external nofollow" <- here the additional value "external" has been added without affecting the function of "nofollow".
  8. #5
  9. No Profile Picture
    Seb
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2008
    Location
    Montreal
    Posts
    24
    Rep Power
    0
    That's quite interesting and I will certainly apply this from now on, but it doesn't solve the theme part of my question which was, do these pages affect the overall theme of my website?

    Thanks.

    Seb
    Last edited by Seb; Oct 1st, 2008 at 02:07 PM.
  10. #6
  11. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2008
    Location
    Coimbatore - India
    Posts
    39
    Rep Power
    11
    The pages u have mentioned like contact us, terms, privacy policy etc. can be blocked from google crawling if those pages are not optimized for any of ur top keywords.

Similar Threads

  1. What is best robot txt coding to insure spiders index all pages?
    By EandA in forum Search Engine Optimization
    Replies: 8
    Last Post: Dec 17th, 2008, 04:10 PM
  2. Link Popularity being Re-Defined and Revised
    By -search-engines-web in forum Google Optimization
    Replies: 17
    Last Post: Sep 2nd, 2004, 01:30 AM

IMN logo majestic logo threadwatch logo seochat tools logo