1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Sep 2017
    Rep Power

    Getting Unknows urls as crawling errors

    My website robot.txt file is open to all search engines few months back.. and also my server folders permisions were open to all (we couldnt analyze it..its our bad) . And after few days we found crawling errors on google search console, that our website been crawling with unknown URLS. which are not in our database...but now we are secured our server permissions and robots.txt..... But the problem is.. still those unknown URLS are getting on google search console crawling errors. Can someone help us
  2. #2
  3. the mango demon
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    Nov 2009
    New Delhi
    Rep Power
    Can you post some sample URLs that are being crawled?
    Are they dynamic URLs? Are they static URLs in a particular folder that you cannot recognize?
    We need more information to be able to help you further.
    SEO Professionals in NewDelhi It is different. Don't believe me? Go check yourself.
  4. #3
  5. Contributing User

    Join Date
    Aug 2017
    Rep Power
    Which are that unknown URLs?
  6. #4
  7. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Nov 2017
    Rep Power
    Seems like you have not provided complete details, Would like to know your unkown URLs?

Similar Threads

  1. Getting unknown urls in Crawling errors?
    By Anjana in forum Google Optimization
    Replies: 4
    Last Post: Nov 20th, 2017, 06:02 AM
  2. Why Old URLs still crawling in google webmaster tools
    By tef in forum Search Engine Optimization
    Replies: 3
    Last Post: Jul 21st, 2016, 07:56 AM
  3. Weird non existent URLs in crawl errors report
    By JenTi28 in forum Google Optimization
    Replies: 4
    Last Post: Apr 6th, 2012, 07:57 AM
  4. Webmasters 3000 errors 404 urls never exsisted?
    By artofmagick in forum Web Design, Coding and Programming
    Replies: 9
    Last Post: Jun 5th, 2010, 09:04 PM
  5. Goog crawling and listing Adwords URLs
    By goffel in forum Google Optimization
    Replies: 4
    Last Post: Jan 25th, 2007, 03:28 AM

IMN logo majestic logo threadwatch logo seochat tools logo