#1
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Dec 2011
    Posts
    11
    Rep Power
    0

    What is Spiders and How They Effect the website


    Hey Every one I want to know what is Search Engine spiders and how they effect the webiste and how we can be safe from it...
  2. #2
  3. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2012
    Posts
    21
    Rep Power
    0
    spider visit your website with the help of sitemap.xml and also robots.txt

    we have to mention our website all url in sitemap.xml file, so that spider can easily find URL for website that need to indexed on search engine.
  4. #3
  5. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2012
    Location
    Germany
    Posts
    3
    Rep Power
    0
    Thanks for the help guys, I know im the not original poster but I thank you for helping me out here! Never knew what spiders really did to a site, kind of built my site not that long ago, and I'm surprised of all the stuff I have yet to know about!
  6. #4
  7. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Apr 2012
    Posts
    10
    Rep Power
    0

    search engine spiders


    What can help search engine spiders in my website? Anyone can give me some tips or ideas regarding the search engine spiders. Thanks...
  8. #5
  9. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2012
    Location
    Wellington
    Posts
    2
    Rep Power
    0
    A search engine works by crawling the web and indexing what it finds. When you do a search you are searching the indexes no the web in real time (that would be way too slow). These processes that index the web are often call spiders, crawlers, robots, bots. Google calls its indexer process googlebot. I hope this helps

IMN logo majestic logo threadwatch logo seochat tools logo