What is best robot txt coding to insure spiders index all pages?

Hello,

I a SEM newbie and wanted to know what is the absolute best robot txt coding one should use to insure Google and the major SE's spiders index all of my sites pages?

I've seen the following used:

<meta content="index,follow" name="robots">

<meta name="robots" content="all">

<meta content="all" name="robots">

Which one is best? Or are they all equally good and does it even matter which one I use?

Next, is there an even better one than these three? If so, what is it?

Lastly, is there any other key coding/files I need to insure spiders index all of my sites page? If so, please list with enought details on how to implement for us newbies!

Many thanks,

Randall

That's the one I use,
<meta name="robots" content="index,follow,all">

You also need to use the robots.txt file in your root directory to keep some robots like Scooter (Altavista) wants to see it there.

Open your notepad in Windows or emacs in Linux and paste this code:

User-agent: *
Disallow:

and save it as "robots.txt" when you upload it chmod 755 it.

Hey biz, does that code matter for GGOOGGLLEE?

As far as I know having the robots tags and robots.txt doesn't hurt, BUT if you are using Google AdSense on any of your pages, then Google requires to use a special User-Agent: type to be used in the robots.txt file.

An important reminder here: Please don't try to spam in that .txt file, as most of the idiot spammers tried to do long ago.

Robots only read that text file to find out their rights to, which folders and pages they are allowed to index.

Nothing else will be read than the

User-agent:
Disallow:

lines by the robots.

I am saying this, because in the past years I have seen some robot.txt files full of keywords. Also Firestarter has found one last week and posted it under the Strange robots.txt post on this board.