|
|||||||||
|
|||||||||
|
|||||||||
 |
|||||||||
| |
||
|
|
|
|
|||||||||
|
|||||||||
|
|||||||||
|
|||||||||
| |
||
|
|
|
| |||||||||
 |
|
|
«
Previous Thread
|
Next Thread
»
|
Thread Tools | Search this Thread | Rate Thread | Display Modes |
SEO Chat Forums Sponsor:
|
|
|
|
#1
December 6th, 2008, 10:27 AM
|
|||
|
|||
|
Scrape Google pages using curl = disadvantages?
I want to use curl to scrape pages from Google search engine. Of course people will see that the pages are from Google, but I want to have the pages embedded in my website.
Can they blacklist the server of your host for fetching the data? I suppose they (Google server,...) can see the fetching and because I have read something about limited use for websites and software developers (1000 hits a day?), I have this kind of questions. I don't want trouble...
|
|
#2
December 6th, 2008, 10:34 AM
|
||||
|
||||
|
Yes, they can deny your IP access for this, after all it's against Google TOS and you're basically stealing their data.
If you want to make use of Google search results in your pages there are legitimate methods, such as their search APIs.
__________________
... I'll be back for breakfast
New to SEO? SEOChat SEO FAQsForum Rules and Posting Guidelines URL canonicalization code solutions Vigorously pursuing the floccinaucinihilipilification of cheap SEO tricks
|
|
#3
December 6th, 2008, 10:47 AM
|
|||
|
|||
|
Quote:
I see you have to use javascript? And that sounds like Google want to control the use and of course with limits etc. Is there another solution for bypassing a Google check?
|
|
| Viewing: SEO Chat Forums > Google > Google Optimization > Scrape Google pages using curl = disadvantages? |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
|
 |
|
|
|
|
|
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Linear Mode
