#1
  1. No Profile Picture
    Registered User

    Join Date
    Apr 2017
    Posts
    15
    Rep Power
    0

    Exclamation Google doesn't respect robots noindex meta tag


    Dear SEOchat community,

    I am facing an issue that Google doesn't respect
    Code:
    <meta name="robots" content="noindex, follow" />
    and has indexed that page.

    The page address is bamilo.com/jome-b-kharid/ and you can find it in SERP by searching "جمعه به خرید".

    Can anyone help me figure and solve the issue? We don't want the page to be indexed.

    ** Important **
    For some reasons, I just changed noindex, follow to index, follow.
    The case is still considerable.


    Thanks,
    Shayan Davoodi
    Last edited by shayandavoodi; Nov 13th, 2017 at 08:00 AM.
  2. #2
  3. SEO Insultant
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Oct 2005
    Location
    sharing a room with my ego
    Posts
    6,427
    Rep Power
    3292
    Was the page already indexed before you added the robots meta tag?
  4. #3
  5. Digital Marketing
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Aug 2008
    Location
    Florida
    Posts
    7,311
    Rep Power
    4894
    My tag looks like this: <meta name='robots' content='noindex,follow' />
    Does the extra space in yours matter?
  6. #4
  7. No Profile Picture
    Registered User

    Join Date
    Apr 2017
    Posts
    15
    Rep Power
    0
    Originally Posted by dzine
    Was the page already indexed before you added the robots meta tag?
    Yes it was. I actually decided not to let it to be indexed after it was indexed already.
  8. #5
  9. No Profile Picture
    Registered User

    Join Date
    Apr 2017
    Posts
    15
    Rep Power
    0
    I don't think so. Empty spaces / breaklines don't matter in HTML.
  10. #6
  11. SEO Insultant
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Oct 2005
    Location
    sharing a room with my ego
    Posts
    6,427
    Rep Power
    3292
    Originally Posted by shayandavoodi
    Yes it was. I actually decided not to let it to be indexed after it was indexed already.
    In that case, maybe the new code hasn't been crawled yet. That might also be if you have something additional in place, like for example a (new) robots.txt file (?)
  12. #7
  13. No Profile Picture
    Registered User

    Join Date
    Apr 2017
    Posts
    15
    Rep Power
    0
    Originally Posted by dzine
    In that case, maybe the new code hasn't been crawled yet. That might also be if you have something additional in place, like for example a (new) robots.txt file (?)
    Thanks for your reply again.
    The page has been crawled Tens of times as far as we check using our monitoring tools.
    As far as I know, robots.txt doesn't block search engines from indexing pages, it just blocks them from accessing resources on the directories.
  14. #8
  15. Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Oct 2017
    Location
    Milton Keynes
    Posts
    26
    Rep Power
    0
    Originally Posted by shayandavoodi
    Yes it was. I actually decided not to let it to be indexed after it was indexed already.
    Assuming you've got Google Search Console setup, then use the Remove URLs Tool to take the page you didn't want indexed out of the search results: https://support.google.com/webmaster.../1663419?hl=en

    This will mean it's no longer visible & next time Google bot crawls your site it will take notice of your updated "noindex" meta tag & the page will not appear in future unless you change the index status again.
  16. #9
  17. the mango demon
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Nov 2009
    Location
    New Delhi
    Posts
    719
    Rep Power
    699
    On the contrary I see this <meta name="robots" content="index, follow"/> in the html source code.
    Before embarking on questioning the system please make sure you are following it.
  18. #10
  19. No Profile Picture
    Registered User

    Join Date
    Apr 2017
    Posts
    15
    Rep Power
    0
    Dear, you should read the entire thread before replying to it I believe.

    I mentioned
    ** Important **
    For some reasons, I just changed noindex, follow to index, follow.
    The case is still considerable.
    Which means that the page was marked "noindex, follow" for at least 5 days and during these days, it got crawled many times. Still in Google's index.

    Thanks for replying btw
  20. #11
  21. the mango demon
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Nov 2009
    Location
    New Delhi
    Posts
    719
    Rep Power
    699
    Re-Create the problem with another url then.
    I don't see any reason wasting time on an imaginary issue.

Similar Threads

  1. Forum with zero post = <meta name="robots" content="noindex, follow">
    By Majora in forum Search Engine Optimization
    Replies: 2
    Last Post: Nov 5th, 2013, 10:24 AM
  2. Google and Noindex blocked by robots.txt
    By roseberry in forum Google Optimization
    Replies: 0
    Last Post: Oct 30th, 2008, 04:26 PM
  3. FYI: meta noindex and robots.txt with google
    By seomonkeymanocp in forum Google Optimization
    Replies: 4
    Last Post: Oct 17th, 2008, 10:31 AM
  4. Robots.txt: It's where it needs to be, Google doesn't see it?!
    By tccommerce in forum Google Optimization
    Replies: 12
    Last Post: Nov 18th, 2007, 09:34 PM
  5. If Google Doesn't Use Meta Tags Then What?
    By brion1234 in forum Google Optimization
    Replies: 1
    Last Post: May 3rd, 2006, 05:26 AM

IMN logo majestic logo threadwatch logo seochat tools logo