Thread: Crawling issues

    #1
  1. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2017
    Posts
    3
    Rep Power
    0

    Crawling issues


    Dear Webmaster,
    We encountered a large number of connection errors when trying to crawl your site.

    We saw 676 errors of this type, which accounts for 5 percent of all requests we made during the last 24 hours.

    Explanation/Recommended Action:
    Bingbot could not access your site due to connection errors. This could be a temporary issue but you should check your server logs to see if you are dropping requests.


    What does this exactly mean? I have no idea on how am gonna solve it. Can anyone help me out on this to find the solution?
  2. #2
  3. Dinosaur
    SEO Chat High Scholar (3500 - 3999 posts)

    Join Date
    Jun 2011
    Location
    UK
    Posts
    3,982
    Rep Power
    6518
    Looks like your server is under powered, change hosting provider
    Owner of Page Explorer the page onsite SEO checker
    Useful Tools: Site Statistics: SEM Rush | Site Crawler: Screaming Frog | Free SSL: Cloudflare
  4. #3
  5. SeoRaptor
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Mar 2016
    Location
    France, Saint-Etienne
    Posts
    994
    Rep Power
    1703
    Chedders put on you on the right track.

    This message means that when Bingbot tryed to access your site, it was not able to do so. This can be due to several factors.

    You deny access to your site to bingbot
    You server was not reachable during a certain amount of time. The reason could be your server was down or that it took too long to response to the bot query.

    You should check in Search Console if Google bot faced the same issue. Changing host could be the easiest way to avoid this kinds of issues in the future, but you should also check if anyone is no loading some files from your server on his site (hotlinking). Hotlinking is like leaching ressources from another server. You should also check in your server logs if you do not receive a lot of queries from unwanted sources, could be analytics spammers etc. If this is the case you should block them the access to your server preserving your resources and allowing a better uptime and a faster response time.
    Owner of Bennetonable - "My opinions are my own - Feel free to disagree & think above the fold."
    Need a quick analysis > Free SEO grader Beta
  6. #4
  7. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2017
    Posts
    3
    Rep Power
    0
    Even I got the same alert message for google webmaster tool too, when checked.
  8. #5
  9. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2017
    Posts
    3
    Rep Power
    0
    How can I deny access to my site to bingbot? Coz of firewall?
  10. #6
  11. Dinosaur
    SEO Chat High Scholar (3500 - 3999 posts)

    Join Date
    Jun 2011
    Location
    UK
    Posts
    3,982
    Rep Power
    6518
    You dont want to deny access you need to fix the firewall if thats whats blocking access.
    I cant for the life of me understand why a firewall rule would be setup to deny access. Unless its to content that is not legal in your country.

    To block access you need to place the URL's in robots.txt but generally that is a really dumb idea.
    Owner of Page Explorer the page onsite SEO checker
    Useful Tools: Site Statistics: SEM Rush | Site Crawler: Screaming Frog | Free SSL: Cloudflare

Similar Threads

  1. Issues with site crawling on MOZ Pro
    By RagsPro in forum New User SEO Questions and Answers
    Replies: 2
    Last Post: Nov 22nd, 2016, 03:46 AM
  2. Crawling Issues
    By Reddy12 in forum Google Optimization
    Replies: 1
    Last Post: May 30th, 2012, 07:38 AM
  3. Difference between Google fresh crawling and main crawling
    By pbsnarayanan in forum Google Optimization
    Replies: 1
    Last Post: May 14th, 2010, 12:29 PM
  4. PDF Crawling
    By chrisef in forum Google Optimization
    Replies: 5
    Last Post: Sep 27th, 2009, 08:46 PM
  5. MSN is crawling
    By sorvoja in forum BING/Yahoo Search Optimization
    Replies: 15
    Last Post: Jun 6th, 2004, 12:23 AM

IMN logo majestic logo threadwatch logo seochat tools logo