Great community. Great ideas.
Welcome to SEOChat, a community dedicated to helping beginners and professionals alike in improving their Search Engine Optimization knowledge. Sign up today to gain access to the combined insight of tens of thousands of members.
Nov 15th, 2012, 04:48 AM
URL blocked by Robots.txt Issue in WMT, Pleas Help!!!
My website - http://infworm.com
Robots.txt - Http://infworm.com/robots.txt
SEO Plugin - Yoast SEO Plugin
Sitemap - http://infworm.com/sitemap_index.xml
I have recently recovered from a problem where my website was accidently put into noindex mode. I have fixed it. Now, I have re-submitted my Sitemap to Google, generated by Yoast plugin. Google Indexes my site weekly and after my site went to index,follow mode; The number of indexed pages in google started increasing slowly, until recently, Google is showing just 2 pages indexed, and with 586 Warnings telling: "Sitemap contains urls which are blocked by robots.txt." and "Sitemap contains urls which are blocked by robots.txt."
In My XML Sitemaps settings in Yoast, I have not excluded any post types in my sitemaps (like images,categories, tags, etc). But I have in Titles and Meta settings - Noindex categories, tags and formats.
Please Help me with the Google WMT sitemaps issue!!!
Nov 15th, 2012, 05:06 AM
The reason those URLs are blocked is exactly the reason Webmaster tools is telling you. You have blocked the /wp-content/ directory so anything in there should be blocked.
Originally Posted by ansrikanth
Last edited by zico82; Nov 15th, 2012 at 05:13 AM.
Nov 15th, 2012, 05:14 AM
Thanks for the quick reply!!
Originally Posted by zico82
I have removed the /content/ disallow line from my robots.txt and re-submitted my sitemap.
Now Google WMT has crawled it and is showing more warnings than the previous time.
What am I still doing wrong related to sitemap_index.xml and robots.txt? I am not getting it!!!
By guna in forum Google Optimization
Last Post: Jan 29th, 2007, 03:40 AM
By jjaall99 in forum Google Optimization
Last Post: Jul 25th, 2006, 08:19 AM