#1
  1. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2003
    Posts
    66
    Rep Power
    17

    Robots.txt and Robots Tag


    Hi all

    Two questions really.

    1) if I exclude /links/ from being indexed using the robots.txt file then surely this will inflate my perceived (by google) page importance since I am being linked to but I am not linking back (I am hiding this fact)... is this true?

    2) if I use robots.txt to exclude a dir (for e.g. /links/) and then have on the page /links/index.html the line <meta name="robots" content="index,follow"> will this override the robots.txt or will the bot even get this far to notice it? Is it like CSS in this respect or?

    Thanks

    Amy
  2. #2
  3. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2003
    Posts
    66
    Rep Power
    17
    I see, yes good points on 1) and as for 2), yes I reckoned that's how it'd work, but it's always nice to have it confirmed

    Thanks

    Amy
  4. #3
  5. Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Dec 2002
    Posts
    36
    Rep Power
    0
    Hi there Amygdala,

    Is that Morrissey?
  6. #4
  7. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2003
    Posts
    66
    Rep Power
    17
    Hehe, nope... although i can see the likeness.

    It's a character from the cult film called EraserHead By Dave Lynch.

    http://www.davidlynch.de/head.html
  8. #5
  9. No Profile Picture
    www.design2host.net
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2006
    Posts
    52
    Rep Power
    13

    interesting


    But not ethical. If you are doing a link exchange then you are most likey to have no links if your link page is a PR0 which you will achieve with a Robot excluding it.

    Its not ethical more over.

    Comments on this post

    • FogHorn agrees : Yea, don't screw other webmasters/SEO's
  10. #6
  11. hctibselgoogtonmai
    SEO Chat Skiller (1500 - 1999 posts)

    Join Date
    Apr 2004
    Posts
    1,919
    Rep Power
    67
    When you start taking advantage of others in the same field... remember, whatever goes around, comes around. And... good luck with the link exchanges, doesn't seem to be much fruit in those pickin's these days and especially when you don't have anything to offer. (smiley here)
    My Favorite Tools: Web CEO - Ranking Reports, Keyword Research, Link Analysis | Hosting.com - U.S. Windows Hosting | ISAPI Rewrite - Rewrite & Redirect for Windows
  12. #7
  13. hi
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jun 2007
    Location
    Shelton, CT
    Posts
    252
    Rep Power
    13
    A very well known SEO'er did this once and caught a lot of **** for it.

Similar Threads

  1. robots.txt file
    By clasione in forum Web Design, Coding and Programming
    Replies: 9
    Last Post: May 23rd, 2004, 10:07 AM
  2. Sly use of robots.txt
    By maluk in forum Link Development
    Replies: 2
    Last Post: Jan 27th, 2004, 08:51 AM
  3. have I done robots.txt correctly please
    By wimbledon in forum Search Engine Optimization
    Replies: 2
    Last Post: Sep 16th, 2003, 07:32 PM
  4. Make a topic on robots?
    By zen in forum Suggestions & Feedback
    Replies: 5
    Last Post: Feb 24th, 2003, 07:11 PM

IMN logo majestic logo threadwatch logo seochat tools logo