
September 25th, 2004, 09:43 AM
|
 |
Contributing User
|
|
Join Date: Apr 2004
Location: Leeds, UK
Posts: 151
Time spent in forums: 1 h 44 m 38 sec
Reputation Power: 5
|
|
Quote: | Originally Posted by oliman Hello guys'n'gals,
Can you specify the possible flaws in a link structure of a website that can cause problems to crawler in properly crawling a website. I have one in mind that circular links can cause one. Like a link on the page that links to the same existing page. But aint crawlers smart enough to avoid that ???
Guys'n'Gals Please brain storm and tell your ideas which can cause crawler problems in fully crawling a site
Thanx a lot ! |
I dont think anything can 'confuse them', guys'n'gals. They're awfully clever things, y'know.
Obviously the only thing that would stop some pages getting noticed is if they were too many clicks deep.
|