Index.txt - blocking pages allows others to become indexed ??
Discuss Index.txt - blocking pages allows others to become indexed ?? in the Google Optimization forum on SEO Chat. Index.txt - blocking pages allows others to become indexed ?? Google Optimization forum discussing techniques to increase rank in Google. Find help for defeating spam pages, building site trust, and beating the Google algorithm. Also read about the best SEO tools to help with Google search.
BuySellLinks.com is a new Text Link Advertising Brokerage by the founder of LinkAdage that offers high-end text links and a premier membership base. We screen all advertisers and publishers and their web pages to make sure we are offering a service that works for everyone. Our plug-in is super easy to install but if you are hands off, w e offer free installation.
Tired of dealing with shady text link buyers and/or sellers? Try BuySellLinks.
Receive the tools necessary to be the rock star of your field. Our 12-month program teaches you the evolving world of multi-channel marketing as well as the complex issues and opportunities found in the industry.
Posts: 955
Time spent in forums: 1 Week 8 h 46 m 2 sec
Reputation Power: 66
Index.txt - blocking pages allows others to become indexed ??
I have 1000 pages listed for my forum, but a lot of them are really unwanted things like profiles, tags etc.
If I block them all with robots.txt will this mean the amount of pages I have listed will reduce or will google find more topics to take the number of listed topics back up to 1000
Posts: 1,919
Time spent in forums: 3 Weeks 23 h 43 m 29 sec
Reputation Power: 60
I can't say with assurity but would suspect that the number of topics would increase.
In the end, it doesn't really matter as those pages add no value to the index so IMO it's best to block... printer friendly, profiles, search, user cp, etc. Go ahead and nofollow them and let us know.
__________________
My Favorite Tools: Web CEO - Ranking Reports, Keyword Research, Link Analysis | Hosting.com - U.S. Windows Hosting | ISAPI Rewrite - Rewrite & Redirect for Windows
Posts: 955
Time spent in forums: 1 Week 8 h 46 m 2 sec
Reputation Power: 66
Quote:
Originally Posted by FogHorn
I can't say with assurity but would suspect that the number of topics would increase.
In the end, it doesn't really matter as those pages add no value to the index so IMO it's best to block... printer friendly, profiles, search, user cp, etc. Go ahead and nofollow them and let us know.
Would you no follow tags as well ? Im trying to work out if they are of any use for seo purposes
Posts: 1,919
Time spent in forums: 3 Weeks 23 h 43 m 29 sec
Reputation Power: 60
Yes, I use the nofollow on all of my links to similar pages. As far as page count/SEO benefit, you'll be much better served by focusing that PR on pages that may deliver value to searchers.
Posts: 955
Time spent in forums: 1 Week 8 h 46 m 2 sec
Reputation Power: 66
Just a quick update here.
The pages do seem to be dropping out the index. The problem at the moment is they arent being replaced by more appropriate pages. Ive dropped from 1000 forum topics listed to around 300.
I hope I have got the coding right in robots and have not somehow dissallowed all forum pages.
Posts: 955
Time spent in forums: 1 Week 8 h 46 m 2 sec
Reputation Power: 66
Nearly all the tags have now been dropped from google. I went from 1000 pages listed down to 200 (ish). Then I woke up one day mid dec and I had 1000+ pages listed.
Sadly yet again, they were mostly unwanted listings. Google was listing all my wap2 pages. So I added them to my robots.txt
Now WAP2 is slowly being removed. Im back down to about 300 pages listed. Im hoping to wake up soon and find 1000 pages of useful forum topics/content listed.
If google finds anything else to index from my site other than the topics, then it wont be a happpy new year round our house. Why does google list everything but what you want it to ??
Posts: 955
Time spent in forums: 1 Week 8 h 46 m 2 sec
Reputation Power: 66
Well what a slow process. Its now 4 month since my initial posts and things are just coming right. According to a site:domain search I have 800 pages listed and all of them appear to be forum topics. This has only come right in the past week.
I had read that google was having problems indexing new pages. Maybe this is why it took so long ??
One thing Ive noted is that with the increase in forum pages, came an increase of bounce rate. Jumping from low 20% to over 30 %.