Google Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsGoogleGoogle Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old November 21st, 2008, 04:21 PM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Index.txt - blocking pages allows others to become indexed ??

I have 1000 pages listed for my forum, but a lot of them are really unwanted things like profiles, tags etc.

If I block them all with robots.txt will this mean the amount of pages I have listed will reduce or will google find more topics to take the number of listed topics back up to 1000

Reply With Quote
  #2  
Old November 21st, 2008, 04:38 PM
FogHorn's Avatar
FogHorn FogHorn is offline
hctibselgoogtonmai
SEO Chat Intermediate (1500 - 1999 posts)
 
Join Date: Apr 2004
Posts: 1,860 FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Weeks 6 Days 18 h 24 m 6 sec
Reputation Power: 45
I can't say with assurity but would suspect that the number of topics would increase.

In the end, it doesn't really matter as those pages add no value to the index so IMO it's best to block... printer friendly, profiles, search, user cp, etc. Go ahead and nofollow them and let us know.
__________________
My Favorite Tools: Web CEO - Ranking Reports, Keyword Research, Link Analysis | Hosting.com - U.S. Windows Hosting | ISAPI Rewrite - Rewrite & Redirect for Windows

Reply With Quote
  #3  
Old November 21st, 2008, 04:43 PM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Quote:
Originally Posted by FogHorn
I can't say with assurity but would suspect that the number of topics would increase.

In the end, it doesn't really matter as those pages add no value to the index so IMO it's best to block... printer friendly, profiles, search, user cp, etc. Go ahead and nofollow them and let us know.


Would you no follow tags as well ? Im trying to work out if they are of any use for seo purposes

Reply With Quote
  #4  
Old November 21st, 2008, 09:02 PM
FogHorn's Avatar
FogHorn FogHorn is offline
hctibselgoogtonmai
SEO Chat Intermediate (1500 - 1999 posts)
 
Join Date: Apr 2004
Posts: 1,860 FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level)FogHorn User rank is Sergeant Major (2000 - 5000 Reputation Level) 
Time spent in forums: 2 Weeks 6 Days 18 h 24 m 6 sec
Reputation Power: 45
Yes, I use the nofollow on all of my links to similar pages. As far as page count/SEO benefit, you'll be much better served by focusing that PR on pages that may deliver value to searchers.

Reply With Quote
  #5  
Old November 22nd, 2008, 03:00 AM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Thanks foghorn.

Think Ill just dissallow to anything with ?action in the url.

will this work as a wildcard to google ?

User-agent: *
Disallow:/forum/?action*

User-agent: *
Disallow:/forum/index.php?action*

Last edited by Glenn Kilpatric : November 22nd, 2008 at 03:32 AM.

Reply With Quote
  #6  
Old December 3rd, 2008, 02:33 AM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Just a quick update here.

The pages do seem to be dropping out the index. The problem at the moment is they arent being replaced by more appropriate pages. Ive dropped from 1000 forum topics listed to around 300.

I hope I have got the coding right in robots and have not somehow dissallowed all forum pages.

Reply With Quote
  #7  
Old December 27th, 2008, 02:17 PM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Nearly all the tags have now been dropped from google. I went from 1000 pages listed down to 200 (ish). Then I woke up one day mid dec and I had 1000+ pages listed.

Sadly yet again, they were mostly unwanted listings. Google was listing all my wap2 pages. So I added them to my robots.txt

Now WAP2 is slowly being removed. Im back down to about 300 pages listed. Im hoping to wake up soon and find 1000 pages of useful forum topics/content listed.

If google finds anything else to index from my site other than the topics, then it wont be a happpy new year round our house. Why does google list everything but what you want it to ??

Reply With Quote
  #8  
Old March 24th, 2009, 12:53 PM
Glenn Kilpatric Glenn Kilpatric is offline
Contributing User
SEO Chat Novice (500 - 999 posts)
 
Join Date: Jun 2006
Location: England
Posts: 734 Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level)Glenn Kilpatric User rank is Sergeant (500 - 2000 Reputation Level) 
Time spent in forums: 5 Days 18 h 52 m 16 sec
Reputation Power: 9
Well what a slow process. Its now 4 month since my initial posts and things are just coming right. According to a site:domain search I have 800 pages listed and all of them appear to be forum topics. This has only come right in the past week.

I had read that google was having problems indexing new pages. Maybe this is why it took so long ??

One thing Ive noted is that with the increase in forum pages, came an increase of bounce rate. Jumping from low 20% to over 30 %.

Reply With Quote
Reply

Viewing: SEO Chat ForumsGoogleGoogle Optimization > Index.txt - blocking pages allows others to become indexed ??


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 6 hosted by Hostway
Stay green...Green IT