#1
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Nov 2017
    Posts
    15
    Rep Power
    0

    Unhappy Crawl Errors Report 404 pages


    Hi guys!
    How Google gets 404 page errors for any search query on website?
    for example i have a search function on website for searching ads, if someone make a search for ad and didnt get relevant result. then how google immediatly fetch that page and show 404 error page in webmaster tool.
    please help me out.
    Thank you!
  2. #2
  3. the mango demon
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Nov 2009
    Location
    New Delhi
    Posts
    719
    Rep Power
    699
    I am finding it hard to understand the situation exactly.
    Do you mean to say, you have a search functionality on your website where the users can search?
    When users search, does it generate a dynamic url using GET method?
    If it does that are you using any recent searches link cloud somewhere that Google can access?
    Unless the answer to all the questions above is Yes, I don't see how Google can reach such a page that does not have a linked path for a BOT to follow.

    Suggested resolution
    Do not create dynamic urls using GET method. Use a POST method to post all results to the same page.
    If there is a "no results found" situation print <meta name="robots" content="noindex, nofollow"/> in the header as a conditional execution.
    Last edited by NewDelhiSEO; Nov 14th, 2017 at 02:22 AM.
    SEO Professionals in NewDelhi It is different. Don't believe me? Go check yourself.
  4. #3
  5. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Nov 2017
    Posts
    15
    Rep Power
    0
    hey! thank you for your kind response, i didnt pretty sure about the method it is GET or POST
    but i think the solutions is much better to handle this situation
    is it same as? if i use <meta name="robots" content="noindex, nofollow"/> on my custom 404 page header.
  6. #4
  7. the mango demon
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Nov 2009
    Location
    New Delhi
    Posts
    719
    Rep Power
    699
    Well No, it is not the same as noindexing the 404 page. I would not recommend that either.
    If you provide the suggested resolution to the programmer he might do it correctly.

Similar Threads

  1. Why GWT Showing 6 Month Old Deleted Pages in Crawl Errors Section
    By sanjayptpl in forum New User SEO Questions and Answers
    Replies: 2
    Last Post: Jun 2nd, 2016, 06:42 PM
  2. How to Fix Crawl Errors
    By use3 in forum Google Optimization
    Replies: 6
    Last Post: Sep 16th, 2015, 12:04 AM
  3. Crawl Errors: 2 errors/ 2 html pages showing.
    By Masseffect3 in forum Google Optimization
    Replies: 5
    Last Post: Sep 12th, 2013, 07:03 PM
  4. Weird non existent URLs in crawl errors report
    By JenTi28 in forum Google Optimization
    Replies: 4
    Last Post: Apr 6th, 2012, 08:57 AM
  5. Replies: 4
    Last Post: Sep 24th, 2011, 07:08 AM

IMN logo majestic logo threadwatch logo seochat tools logo