Discuss Is Deep Crawl still doing its thing? in the Google Optimization forum on SEO Chat. Is Deep Crawl still doing its thing? Google Optimization forum discussing techniques to increase rank in Google. Find help for defeating spam pages, building site trust, and beating the Google algorithm. Also read about the best SEO tools to help with Google search.
BuySellLinks.com is a new Text Link Advertising Brokerage by the founder of LinkAdage that offers high-end text links and a premier membership base. We screen all advertisers and publishers and their web pages to make sure we are offering a service that works for everyone. Our plug-in is super easy to install but if you are hands off, w e offer free installation.
Tired of dealing with shady text link buyers and/or sellers? Try BuySellLinks.
Receive the tools necessary to be the rock star of your field. Our 12-month program teaches you the evolving world of multi-channel marketing as well as the complex issues and opportunities found in the industry.
Posts: 67
Time spent in forums: < 1 sec
Reputation Power: 10
Is Deep Crawl still doing its thing?
How long does DC keep going? I see a bunch of hits to my server from last night, and want to get some good new content up today, but I wont bother if it is most likely finishing by now - I've got lots of other stuff to do as well...
Posts: 681
Time spent in forums: 1 Day 3 h 2 m 53 sec
Reputation Power: 10
Yes, it's still going. It loves my vBulletin board now thanks to dumping the Session ID part of the URL. Yesterday it had got about 169 pages, now it's got atlease 320 pages!!!!
Posts: 475
Time spent in forums: < 1 sec
Reputation Power: 10
NICE !!! Now all i need to do is make my php-nuke site appear static, but my virtual host doesnt support .htaccess... So i need to call the guy who hosts me and get that setup! Hopefully i will get crawled before the next deep crawl!
Posts: 67
Time spent in forums: < 1 sec
Reputation Power: 10
Hey Nintendo, what do you mean by that last post? I must have missed an old thread - does Google frown on session id's in the URLs?
Also, does anyone know if there is a limit to the number of links google will follow on one page? I have some pages with, like, 300 links (all to good, unique content) but will it just cut off past a certain point, or will Deep Crawler index them all?
Posts: 475
Time spent in forums: < 1 sec
Reputation Power: 10
Google HATES session ids in URLs. It will index all of them probably. At somepoint im sure it will end up stopping, but it should go through all of them. However google does frown on pages that are all links. It takes away the PR of them real quick. Well thats just my experience
Posts: 681
Time spent in forums: 1 Day 3 h 2 m 53 sec
Reputation Power: 10
http://www.seochat.com/viewtopic.php?t=190 Has the info about vBulletin boards and session IDs.
I don't think there is a max number of links that can be listed. One of my sites has 'about 12,000' pages listed, and Yahoo has 'about 3,690,000' pages listed!!!!!!!!!
Posts: 475
Time spent in forums: < 1 sec
Reputation Power: 10
I think if there is a SID, google just wont index it or follow the links. The same way it wont index a page if it has too many variables (& or ?'s). Im not sure though, but i do know to stay away from session ids.
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
