Fast: how many documents from one IP-Adress?

Hi!

Fast writes:
"For sites hosting several web-sites on one IP-address, we will limit the total rate of documents fetched from all web-servers on that IP-address."

Does somebody know their limit?

Fast was there tonight, but didn't go further than the first page
There are a few major sites on the server - that's why I suppose it has something to do with it.

CY,
Birthe

I'm just posting again - not sure if I have a "stupid question".

If we would pay for the registration - would the IP still be a problem?

Reg,
Birthe

I think by this they mean they will not crawl the pages too fast so that the webserver would crash.

Don't worry.. Fast are not "fast enough" to crash a webserver .. Well they have the potential to be but I've never seen then crawling at the same rate as some other engines!

Are you sure?

I understand it that way, that too many Sites from one Server is also seen as Spamming. So that they will block spidering from a certain point.

Linking between URL's on one Server is also not worth much. I caught someplace (don't remember where ) a discussion, that it's better to have different C-Blocks for your URL's.

So that's mainly why I am thinking, if in this case a limit is reached. We're talking about over 1500 pages here. (not my bloggitt.de bytheway)

Reg,
Birthe

You were right, Darrin

I know!!!



The only othe option would have been that they wouldn't want to have too many pages in their index.. But given they are trying to compete with google etc.. that would not be in their interest. So it had to be so that they don't want to crash servers.