Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch Engine StrategiesSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old November 5th, 2003, 09:41 PM
Togger Togger is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Apr 2003
Location: Good Ole USA
Posts: 160 Togger User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Send a message via ICQ to Togger Send a message via Yahoo to Togger
Robots

I read that one should have the robot tag on their site. How does one do this?
I use front page.

Reply With Quote
  #2  
Old November 6th, 2003, 01:14 AM
Phoenix's Avatar
Phoenix Phoenix is offline
Contributing User
SEO Chat Beginner (1000 - 1499 posts)
 
Join Date: Jan 2003
Location: Texas!
Posts: 1,135 Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level)Phoenix User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 3 Days 9 h 4 m 3 sec
Reputation Power: 8
Send a message via AIM to Phoenix
Togger,

Funny who you run into, I know one of the past owners of your site. Good guy, hope site is still doing well.

Regarding the Robots tag. Most often webmaster should use this tag in their pages if they are not using robots.txt to properly tell the robots what is and what isn't off limits to them.
I would recommend using this on your pages, and in frontpage all it would take is a simple cut and paste in the HTML code of the head.

Use the following to allow all search engine robots to index the document and follow all links on the page:

<meta name="robots" content="index,follow">

Use the following to block robots:

<meta name="robots" content="noindex,nofollow">


Ben

Reply With Quote
  #3  
Old November 6th, 2003, 01:24 AM
Togger Togger is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Apr 2003
Location: Good Ole USA
Posts: 160 Togger User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Send a message via ICQ to Togger Send a message via Yahoo to Togger
Thanks Ben. Appreciate the help. Is there a specific place where I should place this? If I don't do anything, will that hurt my rankings?

Reply With Quote
  #4  
Old November 6th, 2003, 01:50 AM
seo guy's Avatar
seo guy seo guy is offline
Modsky
SEO Chat Intermediate (1500 - 1999 posts)
 
Join Date: May 2003
Location: canada
Posts: 1,793 seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 10 h 51 m 37 sec
Reputation Power: 8
Send a message via MSN to seo guy
You do not actually need a robots tag for the spider to follow or index any of your site, just use it for noindex nofollow if you want to block spiders robots tag=not necessary however a good robots.txt file will save you tons of bandwidth
cheers

Reply With Quote
  #5  
Old November 6th, 2003, 01:52 AM
Togger Togger is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Apr 2003
Location: Good Ole USA
Posts: 160 Togger User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: < 1 sec
Reputation Power: 6
Send a message via ICQ to Togger Send a message via Yahoo to Togger
the file is just robots.txt and placed where?

Reply With Quote
  #6  
Old November 6th, 2003, 01:58 AM
seo guy's Avatar
seo guy seo guy is offline
Modsky
SEO Chat Intermediate (1500 - 1999 posts)
 
Join Date: May 2003
Location: canada
Posts: 1,793 seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level)seo guy User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 10 h 51 m 37 sec
Reputation Power: 8
Send a message via MSN to seo guy
robots.txt is placed in your root and you can list whatever permissions you want to allow for whatever bots and which ones you want blocked.
Try this for a google robots file: http://www.seo-guy.com/robots.txt all are safe to list you could just copy paste but of course check and see if there are any bots you want to allow
You make it in a simple notpad and save it as robots.txt then like i said justuplaod to the root directory
Good luck

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch Engine StrategiesSearch Engine Optimization > Robots


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway
Stay green...Green IT