SEO Help (General Chat)
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat Forums > Other > SEO Help (General Chat)
Reload this Page

Robots.txt

Discuss Robots.txt in the SEO Help (General Chat) forum on SEO Chat.
Robots.txt SEO Help forum discussing all general topics related to SEO. Help ranges from analyzing domains to reviewing page generators. Relax and talk with other like-minded individuals about anything SEO on your mind.

Record onscreen activity, your voice & webcam video. Turn everyday presentations into HD-quality videos.

For perfectly clear screencasts every time.
  • Use Efficient Tools
  • Increase Revenue Shares
  • Choose from Any Payment Option
  • Convert Any Traffic Sources

Take your business to the next level, with "The Edge of Success: 9 Building Blocks to Double Your Sales." Inside, you will discover how to easily capture more leads, get repeat sales, and significantly grow your business.


Try Camtasia Studio today!
Earn with GreenLabelPPC Today!
Download this FREE ebook now!

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
« Previous Thread | Next Thread »  
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old March 10th, 2003, 12:44 AM
clasione clasione is offline
Veteran SEOCHAT Member
SEO Chat Intermediate (1500 - 1999 posts)
  
Join Date: Feb 2003
Location: USA
Posts: 1,645 clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 3 Days 2 h 17 m 54 sec
Reputation Power: 8
Send a message via MSN to clasione
Robots.txt
Whats the difference between using:

Robots.txt file - Disallow /whatever

or

meta name="robots content="noindex,nofollow" ?

8)
Reply With Quote
  #2  
Old March 10th, 2003, 04:55 AM
simple-biz's Avatar
simple-biz simple-biz is offline
simple-biz.com
SEO Chat Newbie (0 - 499 posts)
  
Join Date: Feb 2003
Location: Thailand, Phuket
Posts: 223 simple-biz User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 5 h 48 m 27 sec
Reputation Power: 7
Send a message via Yahoo to simple-biz Send a message via Skype to simple-biz
The biggest diference is with robots.txt you have a central control over the robots but in the other hand with

meta name="robots" content="noindex,nofollow"

tag in that specific page, only that page will be excluded.

Then again if you have a robots file saying

Disallow /Nothing_specified_here/ even that tag written page will be indexed
Reply With Quote
  #3  
Old March 10th, 2003, 05:16 AM
Darrin Ward's Avatar
Darrin Ward Darrin Ward is offline
Founder, SEOChat.com :)
SEO Chat Beginner (1000 - 1499 posts)
  
Join Date: Dec 2002
Location: Miami, Florida
Posts: 1,444 Darrin Ward User rank is Sergeant (500 - 2000 Reputation Level)Darrin Ward User rank is Sergeant (500 - 2000 Reputation Level)Darrin Ward User rank is Sergeant (500 - 2000 Reputation Level)Darrin Ward User rank is Sergeant (500 - 2000 Reputation Level)Darrin Ward User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 18 h 38 m 44 sec
Reputation Power: 15
The main difference is:

1. Files specified in the robots.txt file should never be crawled (visited by the spider).

2. Files containing the "NOINDEX" tag can be crawled by the spider, but shouldn't be indexed.
__________________
Darrin J. Ward, the Original Founder of SEO Chat (this site), Google Dance Tool & some other cool stuff! Read my: Blog or Twitter.

* Rankings Reporter - Free PHP Script to Track your Website's Keyword Rankings in Google & Yahoo.
Reply With Quote
  #4  
Old March 10th, 2003, 12:38 PM
clasione clasione is offline
Veteran SEOCHAT Member
SEO Chat Intermediate (1500 - 1999 posts)
  
Join Date: Feb 2003
Location: USA
Posts: 1,645 clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 3 Days 2 h 17 m 54 sec
Reputation Power: 8
Send a message via MSN to clasione
Look at Darin coming out with the direct SEO administrative answer....

good info.....
Reply With Quote
  #5  
Old March 10th, 2003, 12:39 PM
clasione clasione is offline
Veteran SEOCHAT Member
SEO Chat Intermediate (1500 - 1999 posts)
  
Join Date: Feb 2003
Location: USA
Posts: 1,645 clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level)clasione User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 3 Days 2 h 17 m 54 sec
Reputation Power: 8
Send a message via MSN to clasione
Quote:
Originally posted by "simple-biz"

The biggest diference is with robots.txt you have a central control over the robots but in the other hand with

meta name="robots" content="noindex,nofollow"

tag in that specific page, only that page will be excluded.

Then again if you have a robots file saying

Disallow /Nothing_specified_here/ even that tag written page will be indexed


thanks simple - im going to have to make a change.......

good thing i asked
Reply With Quote
Reply

Viewing: SEO Chat Forums > Other > SEO Help (General Chat) > Robots.txt

« Previous Thread | Next Thread »

Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Linear Mode Linear Mode
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump




 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.
Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.
Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.
Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.
Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.
Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 




© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 3 Hosted by Hostway. 
For more Enterprise Application Development news, visit eWeek