#1
  1. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2014
    Location
    EU
    Posts
    72
    Rep Power
    0

    Link to sitemap inside robots.txt and/or homepage?


    Is it really necessary to include a link to my website sitemap inside robots.txt file??
  2. #2
  3. Super Moderator
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    6,533
    Rep Power
    3522
    It's not really necessary, but if you have a sitemap you're better listing it there thank linking to it on your website.
    ClickyB
    "The quality of the visitor is more important than the volume..." (Egol 22nd Feb 2008)
    [New to SEO/SeoChat?] [Canonical Problems?] [Forum Rules & Posting Guidelines]
  4. #3
  5. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2014
    Location
    EU
    Posts
    72
    Rep Power
    0
    I have my sitemap submitted to Google through webmasters tools account do I still nee to include the link inside the robots.txt?
  6. #4
  7. Super Moderator
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    6,533
    Rep Power
    3522
    Originally Posted by SureNot
    I have my sitemap submitted to Google through webmasters tools account do I still nee to include the link inside the robots.txt?
    Well there are other search engines (albeit far smaller than Google).

    Is there a reason why you don't want it in your robots.txt?
  8. #5
  9. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    May 2014
    Posts
    9
    Rep Power
    0
    I am thinking this is not important to keep the sitemap in robots.txt..
  10. #6
  11. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2014
    Location
    EU
    Posts
    72
    Rep Power
    0
    @ClickyB you gotta point I will include the link!

    Thanks guyz


  12. #7
  13. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2014
    Location
    EU
    Posts
    72
    Rep Power
    0

    link to sitemap homepage seo?


    Guys I have a link to my sitemap in the robots.txt file but do you think I will get better results by including the link to my sitemap in my website footer?
  14. #8
  15. No Profile Picture

    Join Date
    Sep 2011
    Location
    Auraiya
    Posts
    22
    Rep Power
    0
    Yes You should use Sitemap XML & HTML file in SEO for your site.
  16. #9
  17. No Profile Picture

    Join Date
    Sep 2011
    Location
    Auraiya
    Posts
    22
    Rep Power
    0
    Sometimes website Sitemap is not ached by Search Engine, So it is the best way to tell about your site sitemap by putting a link into Robots file.
  18. #10
  19. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Jan 2013
    Posts
    115
    Rep Power
    0
    Originally Posted by ClickyB
    Well there are other search engines (albeit far smaller than Google).
    Won't their bots find the sitemap on the website? A sitemap is just a guide, they should be able to find every page as long as they are all linked to internally (or externally).
  20. #11
  21. Super Moderator
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    6,533
    Rep Power
    3522
    Originally Posted by Contra
    Won't their bots find the sitemap on the website? A sitemap is just a guide, they should be able to find every page as long as they are all linked to internally (or externally).
    If you link to your sitemap from your website they will find it yes... Although many don't like to do that (me for one) for several reasons (such as):

    You might not want competitors (or surfers) to find your sitemap and discover your full website architecture (you may not want them to know every url on your website).

    If you want to make sure that SE's will follow the sitemap link, you need to place the sitemap link on a prominent page... Which means "wasting" a link from an important page (even if you nofollow the link it will still "cost" your other outbound links some equity).

    If your sitemap links to your pages (as opposed to just listing them) you are "flattening" the architecture of your site (especially with a link from a prominent page, or - worse still {and quite common} a link from every page)!

    When you supply the sitemap url in your robots.txt you don't "waste" any "link juice" (page rank) on it (or equalise the PR flow around your website).
  22. #12
  23. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Mar 2013
    Location
    New Delhi
    Posts
    114
    Rep Power
    61
    Originally Posted by SureNot
    Guys I have a link to my sitemap in the robots.txt file but do you think I will get better results by including the link to my sitemap in my website footer?
    Hey SureNot, you do not need to add a link in your html pages to your xml sitemap. If you have one, no problem but it will be indexed as a normal content.
  24. #13
  25. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2014
    Location
    EU
    Posts
    72
    Rep Power
    0
    I have noticed SEO Chat has one in the footer so I guess it helps SEO as they are #1 SEO site?
  26. #14
  27. Super Moderator
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    6,533
    Rep Power
    3522
    I merged your two threads (because they're so closely related... In fact I answered your second question already)!

    Take a closer look at the SeoChat "Sitemap"... I bet you'll find it's nothing like yours.

Similar Threads

  1. Sitemap in robots.txt
    By phoenix06007 in forum Search Engine Optimization
    Replies: 8
    Last Post: Nov 5th, 2008, 09:51 AM
  2. Robots.txt and sitemap.xml
    By tybi in forum Google Optimization
    Replies: 6
    Last Post: Apr 17th, 2007, 05:14 AM
  3. Sitemap Vs Homepage
    By cunning_stunt in forum Google Optimization
    Replies: 5
    Last Post: Jul 12th, 2006, 05:54 AM

IMN logo majestic logo threadwatch logo seochat tools logo