Search Engine Spiders
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch Engine StrategiesSearch Engine Spiders

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old May 1st, 2009, 12:00 PM
bibowski bibowski is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jan 2009
Posts: 63 bibowski User rank is Private First Class (20 - 50 Reputation Level)bibowski User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 16 h 2 m 45 sec
Reputation Power: 1
Indexed pages : How does this number vary so much?

Ok, I have a number of sites that I perform SEO with, but I have always wondered what algorithms each search engine processes in order to come up with a number of indexed pages?

For instance, one site reports 78 pages in google and a whopping 119 in MSN. For starters, the site only has approx. 50 pages. Does this discrepancy have something to do with dynamic pages, or would it happen with plain html files as well? How can this number be so different from SE to SE.

Reply With Quote
  #2  
Old May 1st, 2009, 12:14 PM
jsteele823's Avatar
jsteele823 jsteele823 is offline
<--- No more IBS :)
Click here for more information. Click here for more information
 
Join Date: May 2007
Location: Georgia, USA
Posts: 1,668 jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level) 
Time spent in forums: 4 Weeks 23 h 37 m 13 sec
Reputation Power: 127
Send a message via Skype to jsteele823
Going from engine to engine will give you different results as they perceive your site's value in different ways, and may not index the same pages.

The dynamic pages would be likely to generate more than one URL for the same page, increasing your number of indexed pages. This should be fixed using the canonical tags introduced recently.
__________________

"To repeat what others have said, requires education; to challenge it, requires brains." - Mary Pettibone Poole, A Glass Eye at a Keyhole, 1938
Want your link here?
SEOChat FAQ's - A good place to start learning
Please read this before posting.

Reply With Quote
  #3  
Old May 1st, 2009, 12:30 PM
bibowski bibowski is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jan 2009
Posts: 63 bibowski User rank is Private First Class (20 - 50 Reputation Level)bibowski User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 16 h 2 m 45 sec
Reputation Power: 1
Quote:
Originally Posted by jsteele823
Going from engine to engine will give you different results as they perceive your site's value in different ways, and may not index the same pages.

The dynamic pages would be likely to generate more than one URL for the same page, increasing your number of indexed pages. This should be fixed using the canonical tags introduced recently.


I'm reading up on using canonical tags, however do they apply to URL rewriting in the same way? I imagine they would.

Reply With Quote
  #4  
Old May 1st, 2009, 12:34 PM
bibowski bibowski is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jan 2009
Posts: 63 bibowski User rank is Private First Class (20 - 50 Reputation Level)bibowski User rank is Private First Class (20 - 50 Reputation Level) 
Time spent in forums: 16 h 2 m 45 sec
Reputation Power: 1
Quote:
Originally Posted by jsteele823
Going from engine to engine will give you different results as they perceive your site's value in different ways, and may not index the same pages.

The dynamic pages would be likely to generate more than one URL for the same page, increasing your number of indexed pages. This should be fixed using the canonical tags introduced recently.


Also, I assume this will not work for pages with different content, due to language. eg. you would not want to use a canonical tag for www.example.com/index.aspx?langid=eng and www.example.com/index.aspx?langid=fr. You would want each page picked up seperately.

Reply With Quote
  #5  
Old May 1st, 2009, 12:36 PM
jsteele823's Avatar
jsteele823 jsteele823 is offline
<--- No more IBS :)
Click here for more information. Click here for more information
 
Join Date: May 2007
Location: Georgia, USA
Posts: 1,668 jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level)jsteele823 User rank is First Lieutenant (10000 - 20000 Reputation Level) 
Time spent in forums: 4 Weeks 23 h 37 m 13 sec
Reputation Power: 127
Send a message via Skype to jsteele823
Quote:
Originally Posted by bibowski
Also, I assume this will not work for pages with different content, due to language. eg. you would not want to use a canonical tag for www.example.com/index.aspx?langid=eng and www.example.com/index.aspx?langid=fr. You would want each page picked up seperately.
Right, but those would be considered different pages to begin with.

The canonical tag is for one page (same exact content) that can be reached by more than one URL. It is different than URL rewrites.

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch Engine StrategiesSearch Engine Spiders > Indexed pages : How does this number vary so much?


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump




 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 




© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 1 Hosted by Hostway
Stay green...Green IT