I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?
Welcome to SEOChat, a community dedicated to helping beginners and professionals alike in improving their Search Engine Optimization knowledge. Sign up today to gain access to the combined insight of tens of thousands of members.
I have a new website. I used wordpress platform. Now I want to use robot.txt file for avoid some page google crawling. Is it possible? Can anyone help me?
You can search for plugins to noindex author, category, tag etc pages.Originally Posted by suprity
Just make sure you don't accidently noindex pages that you do want indexed.. like your homepage.
Last edited by DarrenHaye; Dec 3rd, 2012 at 08:49 PM.
I am always ready to learn although I do not always like being taught. ~Winston Churchill
You can try the WordPress SEO plugin from yoast com. It may very helpful to you.
Please note that the filename is robots.txt
Without the extra 's' it won't work.
Also: you don't really need to use a plugin. If you know which pages to block, then just make a robots.txt file and list those pages. Use the formatting described here: http://www.robotstxt.org/robotstxt.html
...Hey you! DIY your SEO ...I really ♥ my hosting company...
It is possible you can hide page from Google. You just have to add that pages in robots.txt file and Google will not visit that page.
There are lots of online seo tool that will help to create the robots.txt file
Become Part of This Conversation
Join NowFor Free!