#1
  1. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2005
    Posts
    36
    Rep Power
    14

    Question Google sitemap... please help...


    Hi,
    i submited my sitemap yesterday, and waited for veriffication...
    my website url is a folder on my domain:
    not: http://www.domain.com
    it's: http://www.domain.com/site_name/


    (http://www.domain.com also workes fine but because there is a
    redirection to the folder googlebot wont index me.)


    my robots.txt was here: http://www.domain.com/robots.txt
    and my site map here: http://www.domain.com/site_name/sitemap.xml


    i got an error saying that my site map could not be read because there
    was a problem with the robots.txt. (in my robots.txt i didn't
    restricted any page, so i'm not sure what could have been the problem).


    I delete my sitemap from my sitemap account and now when i'm trying to
    resubmit it i get this error instantly (in red writing under the text
    box of the sitemap url):


    "We were unable to access the URL you provided due to a restriction in
    robots.txt. Please make sure the robots.txt file and the Sitemap URL
    are correct and resubmit your Sitemap."


    i deleted my robots.txt files and still this error comes up.
    please help me.
    thanks.
    Last edited by im_new; Jan 9th, 2006 at 04:30 PM.
  2. #2
  3. My SE ran out of Gas...
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Sep 2004
    Location
    Bangalore - India
    Posts
    1,073
    Rep Power
    18
    my website url is a folder on my domain:
    not: http://www.domain.com
    it's: http://www.domain.com/site_name/


    (http://www.domain.com also workes fine but because there is a
    redirection to the folder googlebot wont index me.)
    can you please explain a little more on these points...

    Why couldn't you put a redirect from http://www.domain.com/site_name/ to http://www.domain.com/ instead of the reverse one... (or is it the same ?)

    KICHUS - SEO KiD
    "Sooner or later, those who win are those who believe they can."
    • Virtue SEO - "a plan with the virtue of being practical"

    SEO Consultant India
  4. #3
  5. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2005
    Posts
    36
    Rep Power
    14

    Arrow because of my hosting plan.


    i have a hosting plan that i can use several domain that will direct to my root folder and in my root folder i have a default file that redirects according to the url.

    For example if you enter www.domain1.com it will redirect you to www.domain1.com/domain1/

    And if you enter www.domain2.com you get www.domain2.com/domain2/

    the problem is that google doesn't scan www.domain1.com if it has an automatic redirection. so i use www.domain1.com/domain1/ as my websites address.
  6. #4
  7. Contributing User
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    May 2004
    Location
    127.0.0.1
    Posts
    553
    Rep Power
    70
  8. #5
  9. Super Moderator
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    6,533
    Rep Power
    3522
    Originally Posted by im_new
    i have a hosting plan that i can use several domain that will direct to my root folder and in my root folder i have a default file that redirects according to the url.

    For example if you enter www.domain1.com it will redirect you to www.domain1.com/domain1/

    And if you enter www.domain2.com you get www.domain2.com/domain2/

    the problem is that google doesn't scan www.domain1.com if it has an automatic redirection. so i use www.domain1.com/domain1/ as my websites address.
    That's a real strange set up (understatement)!

    If the domains are all about related subjects why not just have a normal landing page with links to each sub-folder?

    If they are about different subjects you should set them up "normally" (ie: on seperate domains)?

    Are you (in fact) saying that your hosting plan will only allow ONE domain so you have set up these elaborate redirects - using domain forwarding - in order to put all your content onto one domain??? If so, I would get a new hosting plan or use the "normal landing page" solution above.

    Maybe the reason google can't find your robots.txt is because they are trying to look in your root folder, but your redirect is forwarding them to your "domain1 sub-folder", (in which case you could try putting your robots.txt into your domain1 sub-folder).

    Comments on this post

    • Spaggie agrees : It's madness I tell you!
    ClickyB
    "The quality of the visitor is more important than the volume..." (Egol 22nd Feb 2008)
    [New to SEO/SeoChat?] [Canonical Problems?] [Forum Rules & Posting Guidelines]
  10. #6
  11. Contributing User
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    May 2004
    Location
    127.0.0.1
    Posts
    553
    Rep Power
    70

    ...


    Do we know what type of redirect is being used ?
  12. #7
  13. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2005
    Posts
    36
    Rep Power
    14

    Arrow that's how i redirect:


    i have a default.asp page in my root folder and when a user type domain1.com or domain2.com he gets in both case to this file and then the file redirects according to the domain entered.

    i know that this is a really strange and not so recommended but i did it what i was inocent and i belived that whatever me hosting companing says - they know best.

    now i have links from other websites that i don't want to loss, cause they are www.domain1.com/domain1/file.html and not www.domain1.com/file.html.

    i'm not using this hosting plan anymore and i have a defferent one.
  14. #8
  15. Contriving Muser
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Feb 2005
    Location
    $1,500 per sq m
    Posts
    1,119
    Rep Power
    20
    Originally Posted by im_new
    i have a hosting plan that i can use several domain that will direct to my root folder and in my root folder i have a default file that redirects according to the url.

    For example if you enter www.domain1.com it will redirect you to www.domain1.com/domain1/

    And if you enter www.domain2.com you get www.domain2.com/domain2/

    the problem is that google doesn't scan www.domain1.com if it has an automatic redirection. so i use www.domain1.com/domain1/ as my websites address.
    Sounds like a bad hosting plan. Time for a change... (did your hosting company not notice that this is the 21st century?)

    Oops - you're using .asp too? That smells like Microsoft from where I'm sitting... Must you use those things?
    Just another free Anonymity Thingy (yawn!) Like the world needs another, right?
  16. #9
  17. Contributing User
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    May 2004
    Location
    127.0.0.1
    Posts
    553
    Rep Power
    70

    thats when you should use redirects


    Originally Posted by im_new
    now i have links from other websites that i don't want to loss, cause they are www.domain1.com/domain1/file.html and not www.domain1.com/file.html.
    I think you should tidy up how your url's work and then the above sentence is actually legitimate reason for using a redirect properly

Similar Threads

  1. Ranking high on chat keywords
    By southpole854 in forum Public Site Reviews
    Replies: 5
    Last Post: Mar 12th, 2008, 12:55 PM
  2. Google Sitemap Question
    By Roadracer1977 in forum Google Optimization
    Replies: 1
    Last Post: Nov 22nd, 2005, 10:12 AM
  3. Google Sitemap seems to be a waste...
    By callenb in forum Google Optimization
    Replies: 50
    Last Post: Jul 20th, 2005, 04:32 PM
  4. What is Google - An Opinion
    By fvkg in forum SEO Help (General Chat)
    Replies: 9
    Last Post: Jul 6th, 2005, 05:00 AM
  5. SEO FAQs
    By Phoenix in forum SEO Chat FAQs
    Replies: 4
    Last Post: Oct 25th, 2004, 03:05 PM

IMN logo majestic logo threadwatch logo seochat tools logo