Page 2 - Inktomi Indexing...

leedslad73, download Darrin Wards' SpyderTrax at http://www.darrinward.com/

Thanks for the repost of the HotBot filters PK_synths. That helped quell a lot of fears I spent too much on Inktomi. I did paid submissions via insight.lycos.com for Inktomi/FAST. Inktomi only shows 2 pages of a 400+ page storefront, the main url which I submitted for a fee, and a company news page (who knows why they like it). Using your method via HotBot shows they indexed 24 pages... still a far cry away from 400. Now to get FAST to show me something for my $ spent.

Most likely your long dynamic storefront URLs are being rejected. Spiders dont handle URLS that have a ton of "&" and "=" in them

Example:

example.com?storeid=1&userid=435433445&catid=12&itemnum=3&option=4

If your URLs look like that apply a mod_rewrite. It'll make the URLs nice and spider friendly. Go here http://www.engelschall.com/pw/apache/rewriteguide/ for more info.

Good Luck

Thanks PK_synths. I was hoping that wasn't an issue. Google got over the ?'s though a few months ago. I was hoping Inktomi had grown up a bit too. The urls are actually quite longer than what you see, I've applied a 3rd party Miva module to remove the store_code string, and a few other SEO tweaks. There is a 3rd party module for Miva that will create 'search friendly links' that I've been avoiding like the plague (I and my client are cheap s.o.b's unless the ROI is there), but if that's what it takes to make Inktomi work with my site... so be it. This module will turn this link:

http://www.yourstore.com/pathto/merchant.mv? Store_Code=ST&Screen=SFNT&Category_Code=CTGY1&Product_Code=PRD1

Into either of these links (depends on settings):
http://www.yourstour.com/pathto/mer...SFNT/CTGY1/PRD1
or: http://www.yourstore.com/page/ST/SFNT/CTGY1/PRD1

Marc

Actually Google still has problems with dynamic urls. It can index them but only if they have one paramater. Search for "site:www.yourdomain.com" (minus the quotes and replace yourdomain with your domainname) in google and see if google even indexed the store.

Been there, done that... but did it again for sh~ts and grins.

It found 357 pages. Around 24 pages are static (which are the ones that Inktomi found)... the rest are dynamic.

"Results 301 - 357 of about 530"

I'll be getting that module from that vendor. I'm sure it'll help out with Google as well.

Marc

One year old and Ink has been ALL over my site... every day.

My site has been around since late 99. Added a 2nd domain name in 2000 and a 3rd and 4th domain name in 2001 all of which point to the original site. No paid inclusion or submissions to Inktomi. Ink has picked up all 4 domain names that point to the same site in it's index. In fact on some terms we are shown 8 times. No redirects, or fancy stuff, but 8 results for the same search term that end up on the same site. I like Inktomi a lot.

This is a false statement. Google has no problems indexing miva merchant urls with multiple variables (3 to 4). I see them everyday with great rankings as well. Inktomi is a different story and Search Friendly Links from copernicus is the answer.

No it's not. Google can't index dynamic links that have alot of params. The copernicus rewrite is exactly the same as an apache mod_rewrite which turns a dynamic url into a SE friendly static looking URL. Urls like site.com?param=1&param=2&param=3&param=4 are true dynamic URL. Urls like site.com/1/2/3/4 are rewritten dynamic URLS but Google indexes these easily because they appear static. Thats how you bypass the problem of not getting true dynamic URLs indexed.

Search Friendly Links even states "Some search engines will not follow these links while they will follow shorter links with fewer variables."

That is patently absurd and not based on reality. I hear these comments from time to time and are usually based on:

1. I can't or don't know how to get my store listed in Google with the default dynamic urls, therefore it isn't possible for anyone.
2. I can't and don't know how to get my client's dynamic miva merchant urls indexed by Google. I checked them all, and they don't appear. Thus Google doesn't like miva merchant dynamic urls. Although other people including those who specialize in miva merchant and search engines say it is possible, they must be lying.



Except that it works with their module to dynamically rewrite links within the store.



Yep. Just like they do the dynamic urls currently.



For Inktomi, yes. We already know this.



And? "Some search engines" is not google. That description was written a long time ago. Guess who Copernicus refers customers to for seo services in relation to miva merchant? Guess who they consult when developing seo modules for miva merchant? Unfortunately you are over a year behind in the miva merchant seo game.

how is that absurd and not based on reality? i think it's completely logical and based on experience. look around this board and see how many times someone asks why their pages aren't indexed. I never said Google can't index dynamic urls. I said Google has problems with long dynamic urls.



Not everyone uses MIVA or just have dynamic stores. So a mod_rewrite is used more often than a module rewrite. Both accomplish the same thing.



Not long ones. There are some that exist but they are far and few apart. If you manage to get a URL like http://www.yourstore.com/pathto/merchant.mv? Store_Code=ST&Screen=SFNT&Category_Code=CTGY1&Product_Code=PRD1 properly indexed without a rewrite I'll give you a cookie.



And Google.



I really dont care as I dont use MIVA. If it's you congrats on all your MIVA knowledge. But guess what I run Dynamo. Guess why my pages didn't get indexed in Google? Guess what happened when I rewrote my URLs with mod_rewrite?

As much as you dont want to believe it Google can't index long dynamic URLs. Google doesn't crawl certain dynamic URLs because the spiders get stuck in a loop aka "spider trap".

I'm standing behind that unless everyone and their mom tells me I'm full of cr*p.

Because we see it all the time.



Exactly! "Your" experience is very limited obviously. You are making blanket statements that do not apply to everyone.



You responded to a post about miva merchant, and you were dead wrong. Here is exactly what you said in response to a post regarding miva merchant

"Actually Google still has problems with dynamic urls. It can index them but only if they have one paramater."

You are just plain wrong!



I'm not concerned about those who don't use miva or miva merchant. You responded to a post on miva merchant with false and misleading information.



They are few and few apart for you, and this your problem. You don't even know how to properly construct a miva merchant url. You can keep your cookies.



Than stop pretending and don't respond to posts about miva merchant.



Good for you. Now back to miva merchant.



My statements have nothing to with belief unlike yourself. They are from fact and observing them every single day.



No, really? That is nothing new.



You can live in ignorant bliss if you want. I will make sure nobody else has to do the same.

Man believe anything you want. If a MIVA merchant store could be indexed completely than you wouldn't need a module rewrite would you. But your right. You win. Gold star next to your name and all that jazz.

Is it me or do people like to start **** on fridays?? BTW jmh I'm not continuing this conversation because as someone that works with MIVA and is a consultant you sure have a biased sense of thinking.

Have a great one.

Switching things up again? Module rewrite applies to Inktomi. I never said it could be indexed completely with all search engines. It was specifically mentioned for Inktomi only. Sounds like you are mixed up.



nfire:



Nope, it is just you.



Facts on your side and knowing what you are talking about = biased sense of thinking ??: Okay. Thanks. You too.