#1
  1. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Oct 2004
    Location
    England
    Posts
    110
    Rep Power
    13

    Banning bots for test website - is it possible?


    Hi, I've tried searching for example .htaccess files and robots.txt files, but to be honest the examples I've seen have confused this simple soul until I'm not sure whether I'm coming or going.

    I currently have dress business on my ".com" and I want use my ".co.uk" site for testing changes we are looking to implement.

    After recently looking at the logs on my "co.uk" I see that google has been indexing our test site, so I presume we have a hit a duplicate content filter.

    How do I stop bots from indexing our test site? i.e. what do i need to put into my robots.txt file or .htaccess file.

    Would I be right to assume that these settings in my .htaccess file:

    RedirectMatch permanent ^/$ http://www.berkswelldirect.com/cgi-bin/cp-app.cgi

    RedirectMatch permanent ^/cgi-bin/cp-app.cgi$ http://www.berkswelldirect.com/cgi-bin/cp-app.cgi

    RedirectMatch permanent ^/plus-size-dress(.*)$ http://www.berkswelldirect.com/plus-size-dress$1

    Sorry for the direct details (think I've stopped it from creating a proper link), but I really, really don't want to get a space or character wrong.

    TIA.
    Last edited by berkswelldirect; Jun 8th, 2005 at 04:29 PM.

Similar Threads

  1. How to submit your website in msn within 48 hours
    By superbrand in forum BING/Yahoo Search Optimization
    Replies: 0
    Last Post: May 17th, 2005, 10:33 PM
  2. website address names and SEO
    By tyler_durden in forum Google Optimization
    Replies: 10
    Last Post: Mar 30th, 2005, 01:22 AM
  3. Google Can't Find Today's Hottest Website
    By Surf-Dude in forum Google Optimization
    Replies: 53
    Last Post: May 16th, 2004, 12:04 AM
  4. Optimising your website for a different country
    By leedslad73 in forum Google Optimization
    Replies: 4
    Last Post: Feb 26th, 2004, 12:15 PM

IMN logo majestic logo threadwatch logo seochat tools logo