Google Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsGoogleGoogle Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old August 11th, 2008, 04:19 PM
Londoner Londoner is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Mar 2003
Location: London UK
Posts: 203 Londoner User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 4 Days 12 h 8 m 28 sec
Reputation Power: 0
Removing 100's of urls

Hello,

I have quite a few pages within my web site which I'd like google to stop indexing. This has happened mainly due to products which no longer exist, hence I then delete the product from the database.

These URLs only exist because I cannot make it redirect a 301 to the homepage(ideally) or 404, it just generates the standard header.php left and right sections of the web site along with a blank page in the mid section where the product detail used to exist.

Because of a url rewrite rule we use, any url you type into the browser such as thedomainname.com/real-product.html and thedomainname.com/anything-here-at-all.html will load a page. The latter being the problem! I've asked the web designer to find a way of only allowing actual URLs from products that exist in the database, but they haven't found a solution for this just yet, albeit it's only a few days since I asked them, but they don't seem confident ATM.

Whats the best way of having google delete these products from their index without using any 301 or internal fixes?
Is it possible to disallow a whole list of specific URLs using a robots.txt file?

Thanks

Reply With Quote
  #2  
Old August 11th, 2008, 04:39 PM
purrp purrp is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2008
Location: Toronto
Posts: 29 purrp User rank is Lance Corporal (50 - 100 Reputation Level)purrp User rank is Lance Corporal (50 - 100 Reputation Level)purrp User rank is Lance Corporal (50 - 100 Reputation Level) 
Time spent in forums: 15 h 12 m 30 sec
Reputation Power: 0
robots.txt should do the trick, you can also look at Google Webmaster Tools, it has a remove URL option.

However, I would really push the webmaster to find a more permanent solution. Any visitors that come to your site through an old link and end up with a page with no content might potentially result in a lost sale.

Reply With Quote
Reply

Viewing: SEO Chat ForumsGoogleGoogle Optimization > Removing 100's of urls


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 5 hosted by Hostway
Stay green...Green IT