|
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
| |||||||||
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread |
Rating:
|
Display Modes |
|
#121
|
|||
|
|||
|
16 - Don't cloak. What does this mean?
|
|
#122
|
||||
|
||||
|
Quote:
Serving up a different page to search engine bots and crawler than what the browser agent gets.
__________________
We are what we repeatedly do… excellence, then, is not an act, but a habit. — Aristotle |
|
#123
|
||||
|
||||
|
Quote:
Session IDs are available in most websites that require a user to 'login'. As automated tools [search engine bots] can't action a "login" they can't read anything that is only available to a "logged in person"... which prevents your website in near totality from being crawled and indexed. This is the case for all forums [such as phpBB & vBulliten] that do not allow "guest posts". Just consider the "bot" as a guest and modify your forum so that guests have "read" capabilities. |
|
#124
|
||||
|
||||
|
Quote:
Makes sense. That is why the forums are made in such a way so that Guests could at least read...but for posting, a guest needs to become a member. This way, Googlebot (or any other spider for the matter) will get to read (i.e. index) the discussion that went through in the forum. It helps in site promotion (provided the forum discussed on relevant topic). Regards WC
__________________
www.zinfi.com www.zinfitech.com www.zinfiprojects.com |
|
#125
|
|||
|
|||
|
Thanks a lot for the useful tips for SEO.
I have built a website(http://www.mad4f1.com), I have taken care of all the points that you have mentioned except for the point 2 and 3 (adding robot tags), the site is already live for more than one month, but still it has not appreared on the search engines properly. Can you sggest some thing. Tukesh Quote:
|
|
#126
|
||||
|
||||
|
Dear Tukesh,
Congratulations for doing a wonderful site. It looks great...rich in content. I am assuming you have done the submission etc. & are now waiting to see your website name surface up on search result pages. You have placed Google Ad words on your site & that is displaying relevant content i.e. Google is reading your page properly. So, no reason to worry. Have patience...your site should appear in search engines..in no time. Regards WC PS: BTW...you are atlaest in Yahoo for sure. |
|
#127
|
||||
|
||||
|
BTW,
On 2nd look...I didn't understand the logic for your robots.txt. It states: User-agent: * Disallow: / Why would you disallow the root? I will rather put it this way: User-agent: * Disallow: Now, coming to the tech matters:
Last edited by webcoder : April 13th, 2005 at 12:19 AM. Reason: Textual |
|
#128
|
||||
|
||||
|
Quote:
hmmm... Disallow "all search engines from every part of your website" - is what this means! |
|
#129
|
||||
|
||||
|
Quote:
That is what scared me. Regards WC |
|
#130
|
|||
|
|||
|
Thanks a lot for your feedback...I really appreciate that....
I am wondering...how did robot.txt file came to by site, I have never put that file..and I dont see such file in the root folder also.... can you tell me...how did you find that file in my site and how can I modify that. Thanks again, Tukesh Quote:
|
|
#131
|
||||
|
||||
|
Hmnn.....this is fishy. When I replied the 2nd time, it was based on my findings by checking:
http://www.mad4f1.com/robots.txt Now...as I try accessing the link, I get a 404 error. If you are not aware of this...did your developer/seo-guy did so? I hope no one else is controlling your site, right? Regards WC |
|
#132
|
|||
|
|||
|
Thats very surprising...except myself nobody has the access to the site...
so what do you think..should I put a robots.txt file in my website....if yes where do i need to put that file... Thank for your time, Tukesh... Quote:
|
|
#133
|
||||
|
||||
|
Quote:
Unless you want to specifically stop the spiders from indexing any particular directory, you can safely do without any robots.txt. If you at all want to use robots.txt, it should ideally go to the root of the web folder i.e. it should be found at "http://www.mad4f1.com/robots.txt" Hope this helps. Regards WC |
|
#134
|
|||
|
|||
|
Thanks again... To be on safer side, I have just added robots.txt in my website, http://www.mad4f1.com/robots.txt Few more thi |