|
|||||||||
|
|||||||||
|
|||||||||
 |
|||||||||
| |
||
|
|
|
|
|||||||||
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
|
|
|
| ||||||||||||||||||||||||||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
SEO Chat Forums Sponsor:
|
|
|
|
#1
February 2nd, 2007, 02:06 PM
|
|||
|
|||
|
Robot no index
<html xmlns="http://www.w3.org/1999/xhtml"', $context['right_to_left'] ? ' dir="rtl"' : '', '><head>
<meta http-equiv="Content-Type" content="text/html; charset=', $context['character_set'], '" /> <meta name="description" content="', $context['page_title'], '" />', empty($context['robot_no_index']) ? '' : ' <meta name="robots" content="noindex" />', ' <meta name="keywords" content="PHP, MySQL, bulletin, board, free, open, source, smf, simple, machines, forum" /> I found this bit of code in my forum. http://www.whitbyseaanglers.co.uk/forum/index.php*removethisandthestar I dont like the look of the words robot no index Does this mean what I think it does ? Should I remove that code ?? Would anyone be kind enough to look at my forum and tell me if the pages are blocked from the robots ? Many thanks - Glenn Last edited by Glenn Kilpatric : February 2nd, 2007 at 02:09 PM.
|
|
#2
February 2nd, 2007, 02:15 PM
|
||||
|
||||
|
It depends on what you want.
It means that the search engines should not index THIS particular page with THIS particular URL. But if you have a similar page with almost the same content and with ANOTHER URL - but which does not have the robots meta - then it's likely that the search engines will index THAT one instead. For example, you could want the bots to spider your archive pages instead of your dynamic forum pages.... If all that's not the case, then remove the line (or comment it out) and test without it. But erm.... who put that in your code in the first place   One of the admin settings?
|
|
#3
February 2nd, 2007, 06:47 PM
|
|||
|
|||
|
Hi dzine.
The company that wrote the forum software put it in the code. I'm a bit worried this means the bots wont read my forum. Is there a way to test if the bots can read the forum topics?
|
|
#4
February 3rd, 2007, 02:35 AM
|
||||
|
||||
|
Well, if you have access to your logs, you may find lots of bot visits to your robots.txt file - and stopping there.
Also, if the forum has been up for some time and if you have pointed a couple of external links to it -- and it still doesn't show up on Google, Yahoo and Live.com when you use a site: search -- then I think there's only one conclusion. Live.com shows something, but when I looked at the cache of that page, the "robots" meta wasn't there. I guess it's not in the forum home page template, is it? But: can't you just take it out of the script(s)? I'm 99.9% sure there is a setting somewhere on your SMF admin panel that controls this (by setting 'robot_no_index'). I don't know exactly where, because I don't have a forum running the same version scripts as yours.  Last edited by dzine : February 3rd, 2007 at 03:00 AM.
|
|
#5
February 3rd, 2007, 03:35 AM
|
||||
|
||||
|
Follow-up:
I have found out that SMF automatically adds the noindex bit on pages that have message IDs etc. in the url. On your forum, that means that URLs like http://www.whitbyseaanglers.co.uk/forum/index.php/topic,154.0.html will be spidered, but URLs like http://www.whitbyseaanglers.co.uk/forum/index.php/topic,154.msg429.html#new won't. So if a bot visits your homepage and follows a link to one of the boards, then it may also follow a regular link to any of the threads on that board. I just checked it and if the bots follow the "normal" flow of things on your forum, they are NOT blocked. Next step: blogging about your forum and linking to some of its inner pages (using the correct URL, of course) Good luck.
|
|
#6
February 3rd, 2007, 03:39 AM
|
|||
|
|||
|
Thanks dzine,
Much appreciated mate. I have a blog so will add some links there today. Many thanks for your help, it is really apreciated. Kindest regards - Glenn
|
|
| Viewing: SEO Chat Forums > Other > HTML Coding > Robot no index |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
|
|
|
 |
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
