#1
  1. No Profile Picture
    Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Oct 2004
    Posts
    157
    Rep Power
    15

    scroogle how to?


    I've seen this before but really didnt care at the time.
    How does scroogle have their tool that checks rankings across various data centers run EXTREMELY fast?
    It makes no sense.. and runs MUCH faster than anything that does the same thing that I could make (and i'm an expert at php and php optimization)
    The tool is at scroogle.org/scraper3.html for anyone that wants to know.
    Please post your opinions.
    thanks
  2. #2
  3. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Feb 2005
    Posts
    9
    Rep Power
    0

    forking


    It simply forks off a new process for each data center query. This way the program doesn't have to wait for the previous query to return before starting the next one. Other than that it is a simple screen scrape.

    This should probably be moved to a more appropriate forum.
  4. #3
  5. No Profile Picture
    Contributing User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Nov 2003
    Posts
    96
    Rep Power
    16
    There's a source code link at the bottom of that page for a one-fork process. It's written in C. Just add as many forks as you need. Launch them all simultaneously, and then go into a waiting loop to check them off when they return. After they all return, or after a timeout (6 seconds in this program), kill any forks that haven't yet returned and start processing the files.

    Doing 65 IP addresses took the same amount of time as the current 17 IP addresses, but uses much more bandwidth.

    It's called "multi-threading."
  6. #4
  7. Contributing User
    SEO Chat Adventurer (500 - 999 posts)

    Join Date
    May 2004
    Posts
    752
    Rep Power
    15
    Yes it is fast, I don't how safe to use it...seems google banned site.
  8. #5
  9. No Profile Picture
    Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Oct 2004
    Posts
    157
    Rep Power
    15
    ah i knew they had a source code, I was just looking on wrong page

Similar Threads

  1. Is scroogle outdated?
    By a_Cylinder in forum Google Optimization
    Replies: 1
    Last Post: Apr 20th, 2004, 04:43 AM
  2. Scroogle has been blocked by Google
    By Kackle in forum Google Optimization
    Replies: 21
    Last Post: Dec 8th, 2003, 09:31 PM
  3. Scroogle Site Down
    By SuperMac in forum Google Optimization
    Replies: 0
    Last Post: Dec 4th, 2003, 10:38 AM
  4. Scroogle Poison-Words Changing
    By Surf-Dude in forum Google Optimization
    Replies: 5
    Last Post: Dec 3rd, 2003, 10:50 AM
  5. Ban scroogle!
    By Tipsy in forum Google Optimization
    Replies: 5
    Last Post: Dec 1st, 2003, 11:27 PM

IMN logo majestic logo threadwatch logo seochat tools logo