Great community. Great ideas.

Welcome to SEOChat, a community dedicated to helping beginners and professionals alike in improving their Search Engine Optimization knowledge.  Sign up today to gain access to the combined insight of tens of thousands of members.

  1. May 16th, 2013
    Views:
    157

Thread: How can I create a robot.txt file using google?

Results 1 to 6 of 6
Share This Thread →
  1. #1
    suprity is offline Registered User SEO Chat Explorer (0 - 99 posts)
    Join Date
    Oct 2012
    Posts
    1
    Rep Power
    0

    How can I create a robot.txt file using google?

    I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?

  2. #2
    Join Date
    Aug 2011
    Location
    London, Uk
    Posts
    2,381
    Rep Power
    1462
    Quote Originally Posted by suprity
    I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?
    You can search for plugins to noindex author, category, tag etc pages.

    Just make sure you don't accidently noindex pages that you do want indexed.. like your homepage.
    Last edited by DarrenHaye; Dec 3rd, 2012 at 08:49 PM.
    I am always ready to learn although I do not always like being taught. ~Winston Churchill

  3. #3
    venkatseo is offline Contributing User SEO Chat Explorer (0 - 99 posts)
    Join Date
    Jul 2008
    Posts
    78
    Rep Power
    0

    wordpress

    You can try the WordPress SEO plugin from yoast com. It may very helpful to you.

  4. #4
    dzine's Avatar
    dzine is offline DIYSEO SEO Chat Mastermind (5000+ posts)
    Join Date
    Oct 2005
    Location
    sharing a room with my ego
    Posts
    5,177
    Rep Power
    1629
    Please note that the filename is robots.txt
    Without the extra 's' it won't work.

    Also: you don't really need to use a plugin. If you know which pages to block, then just make a robots.txt file and list those pages. Use the formatting described here: http://www.robotstxt.org/robotstxt.html
    ...Hey you! DIY your SEO ...I really my hosting company...

  5. #5
    joseph02's Avatar
    joseph02 is offline Contributing User SEO Chat Discoverer (100 - 499 posts)
    Join Date
    Dec 2012
    Location
    USA
    Posts
    111
    Rep Power
    0
    It is possible you can hide page from Google. You just have to add that pages in robots.txt file and Google will not visit that page.

  6. #6
    corlif is offline Registered User SEO Chat Explorer (0 - 99 posts)
    Join Date
    Feb 2013
    Posts
    40
    Rep Power
    0
    There are lots of online seo tool that will help to create the robots.txt file

Share This Thread →

Become Part of This Conversation

Join NowFor Free!

Similar Threads

  1. Booble.com's response to Google
    By Sam I Am in forum Google Optimization
    Replies: 33
    Last Post: Sep 15th, 2006, 10:18 PM
  2. My Google Nightmare, The Horror Story Continues
    By netcultur in forum Google Optimization
    Replies: 0
    Last Post: Jul 9th, 2005, 03:14 PM
  3. SEO FAQs
    By Phoenix in forum SEO Chat FAQs
    Replies: 4
    Last Post: Oct 25th, 2004, 03:05 PM
  4. Google Friends Newsletter December
    By Phoenix in forum Search Engine Optimization
    Replies: 1
    Last Post: Dec 5th, 2003, 11:50 PM
  5. Google End?
    By analogik in forum Google Optimization
    Replies: 12
    Last Post: Sep 17th, 2003, 07:37 PM

SEO Chat Advertisers and Affiliates