#1
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2004
    Posts
    4
    Rep Power
    0

    Stop Google from indexing the page


    I suppose that this has been asked before, but I could not find it, so I apologize in advance.

    Is there a way not to allow Google to list one of my pages?
    Actually, it would be good that no one can't see it. There is no link to this page but somehow Google found it.

    I would appreciate any help.
  2. #2
  3. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jul 2003
    Location
    Texas
    Posts
    276
    Rep Power
    16

    Robots.txt


    Look for a robots.txt tutorial.

    I have never had a site with no inbound links listed in Google. Are you sure no one has linked to the page?

    Good luck,
    Shannon
  4. #3
  5. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Apr 2004
    Location
    South Florida
    Posts
    248
    Rep Power
    16
  6. #4
  7. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2004
    Posts
    4
    Rep Power
    0
    Shannon and SumOne,

    Thank you for your replies.

    Will this stop other search engines, also? I am not sure (now that you told me the thing about the links, and to be honest I wasn't before) that I do not have any link to my "hidden" page, since the web site has a lot of contents and it is shared by many users. How can I make sure that no one can find the page?

    Thank you, again.
  8. #5
  9. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jul 2003
    Location
    Texas
    Posts
    276
    Rep Power
    16

    Robots.txt tutorial


    View the robots.txt tutorial here.

    http://www.searchengineworld.com/rob...s_tutorial.htm

    I believe something like the two line text file

    User-agent: *
    Disallow: page.htm

    Will do the trick. The "*" indicates all robots. In place of page.htm put the name of your page.

    Use any text editor to make. Save as text file called robots.txt and upload to root directory.

    I am not an expert at robots.txt files so suggest you do your own research.

    Shannon
    Last edited by Shannon Smyrl; May 31st, 2004 at 12:02 PM.
  10. #6
  11. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jul 2003
    Location
    Texas
    Posts
    276
    Rep Power
    16

    Other ideas


    If I did not want page available to random viewers I would immediately change name of page and put up robots.txt keep it from being indexed.

    For more security I would put it up under new name in a password protected directory with a robots.txt exclusion. Then furnish password to users on need to know basis.

    Good luck.

    S
  12. #7
  13. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    May 2003
    Location
    Norway
    Posts
    173
    Rep Power
    16
    You could also use:
    <meta name="robots" content="noindex,nofollow">
    on that particular page.

    More info:
    http://www.robotstxt.org/wc/meta-user.html

    This wont hide your page, just prevent it from getting spidered..
  14. #8
  15. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2004
    Posts
    4
    Rep Power
    0
    Originally Posted by Shannon Smyrl
    If I did not want page available to random viewers I would immediately change name of page and put up robots.txt keep it from being indexed.

    For more security I would put it up under new name in a password protected directory with a robots.txt exclusion. Then furnish password to users on need to know basis.
    Hehe, I might be boring. I think I will manage with robots, thank you, but I also wanted to put .htaccess, so I found some example, and they do not work. Could you help me with this, also? I want to put several users, but I do not know how to make .htpasswd file. Also, when I put .htaccess file with AuthUserFile C:\Inetpub\wwwroot\forexample\.htpasswd which have following line:

    user:password

    I get through, and I do not get prompted for username and password. It is good that I have iron nerves, but I am really starting to lose patience with this.

    Thank you in advance.
  16. #9
  17. Contributing User
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Apr 2004
    Location
    Texas, USA
    Posts
    552
    Rep Power
    16
    I suggest you contact your web host and ask them how to password protect the page. They know exactly how their servers are set up and should be able to help you quickly.
  18. #10
  19. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2004
    Location
    Hackettstown, NJ
    Posts
    82
    Rep Power
    15
    Originally Posted by JohnD
    Hehe, I might be boring. I think I will manage with robots, thank you, but I also wanted to put .htaccess, so I found some example, and they do not work. Could you help me with this, also? I want to put several users, but I do not know how to make .htpasswd file. Also, when I put .htaccess file with AuthUserFile C:\Inetpub\wwwroot\forexample\.htpasswd which have following line:

    user:password

    I get through, and I do not get prompted for username and password. It is good that I have iron nerves, but I am really starting to lose patience with this.

    Thank you in advance.
    Try adding the following to your .htaccess file:

    AuthUserFile C:\Inetpub\wwwroot\forexample\.htpasswd
    AuthName "Restricted"
    AuthType Basic

    <Limit GET POST PUT>
    require valid-user
    </Limit>
  20. #11
  21. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2004
    Posts
    4
    Rep Power
    0
    Originally Posted by christowang
    Try adding the following to your .htaccess file:

    AuthUserFile C:\Inetpub\wwwroot\forexample\.htpasswd
    AuthName "Restricted"
    AuthType Basic

    <Limit GET POST PUT>
    require valid-user
    </Limit>
    Thank you christowang,

    If I understood well some posts on other forums, it turns out that .htaccess does not work on IIS (because this is the web server that I use). Furthermore, there seems to be no way to do this in efficient way on IIS. Am I right?
  22. #12
  23. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2004
    Posts
    2
    Rep Power
    0

    Smile Actually...


    Actually there is.. There is a program package, IISPassword that is able to use .htaccess on IIS... You may wanna take a look and see if and how it works

  24. #13
  25. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2004
    Posts
    2
    Rep Power
    0

    Ehm...


    Ehm... the site for IISPassword is http://www.troxo.com/products/iispassword/

Similar Threads

  1. Stop This Google Maddness!
    By waxbrat in forum Google Optimization
    Replies: 5
    Last Post: Nov 29th, 2003, 12:46 AM
  2. Google isn't indexing my site's pages
    By CokeCan in forum Google Optimization
    Replies: 4
    Last Post: Aug 30th, 2003, 11:52 AM
  3. Google changing indexing procedures ...
    By internetheaven in forum Google Optimization
    Replies: 3
    Last Post: Mar 28th, 2003, 03:08 PM
  4. Help - What happened to my latest page listing on google??
    By Michelle in forum Google Optimization
    Replies: 7
    Last Post: Mar 6th, 2003, 06:21 PM

IMN logo majestic logo threadwatch logo seochat tools logo