#1
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Oct 2012
    Posts
    1
    Rep Power
    0

    How can I create a robot.txt file using google?


    I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?
  2. #2
  3. -
    SEO Chat Super Hero (2500 - 2999 posts)

    Join Date
    Aug 2011
    Location
    London, Uk
    Posts
    2,676
    Rep Power
    1593
    Originally Posted by suprity
    I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?
    You can search for plugins to noindex author, category, tag etc pages.

    Just make sure you don't accidently noindex pages that you do want indexed.. like your homepage.
    Last edited by DarrenHaye; Dec 3rd, 2012 at 08:49 PM.
    I am always ready to learn although I do not always like being taught. ~Winston Churchill
  4. #3
  5. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2008
    Location
    Chennai
    Posts
    88
    Rep Power
    0

    wordpress


    You can try the WordPress SEO plugin from yoast com. It may very helpful to you.
  6. #4
  7. SEO Insultant
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Oct 2005
    Location
    sharing a room with my ego
    Posts
    5,802
    Rep Power
    1798
    Please note that the filename is robots.txt
    Without the extra 's' it won't work.

    Also: you don't really need to use a plugin. If you know which pages to block, then just make a robots.txt file and list those pages. Use the formatting described here: http://www.robotstxt.org/robotstxt.html
    ...Hey you! FREE SEO report card ...I really my hosting company...
  8. #5
  9. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Dec 2012
    Location
    USA
    Posts
    100
    Rep Power
    0
    It is possible you can hide page from Google. You just have to add that pages in robots.txt file and Google will not visit that page.
  10. #6
  11. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Feb 2013
    Posts
    37
    Rep Power
    0
    There are lots of online seo tool that will help to create the robots.txt file

Similar Threads

  1. Booble.com's response to Google
    By Sam I Am in forum Google Optimization
    Replies: 33
    Last Post: Sep 15th, 2006, 10:18 PM
  2. My Google Nightmare, The Horror Story Continues
    By netcultur in forum Google Optimization
    Replies: 0
    Last Post: Jul 9th, 2005, 03:14 PM
  3. SEO FAQs
    By Phoenix in forum SEO Chat FAQs
    Replies: 4
    Last Post: Oct 25th, 2004, 03:05 PM
  4. Google Friends Newsletter December
    By Phoenix in forum Search Engine Optimization
    Replies: 1
    Last Post: Dec 5th, 2003, 11:50 PM
  5. Google End?
    By analogik in forum Google Optimization
    Replies: 12
    Last Post: Sep 17th, 2003, 07:37 PM

IMN logo majestic logo threadwatch logo seochat tools logo