Can I scrape with meteor.js? Just discovered cheerio
which works excellent combined with request
. Can I use these with meteor, or is there something similar?
Do you have an working example?
Can I scrape with meteor.js? Just discovered cheerio
which works excellent combined with request
. Can I use these with meteor, or is there something similar?
Do you have an working example?
now you should use meteorhacks npm package https://github.com/meteorhacks/npm and require this with :
worked for me :)
You can have a look to http://casperjs.org/ which is very useful. You can also do screenshots, automated test, etc...
The following code is used in this project to scrape a tweetstorm:
Server side
Of course! Its hard to imagine what meteor can't do! First you need something to handle the remote http requests. In your meteor directory in the terminal run
meteor add http
to add theMeteor.http
package, alsonpm install cheerio
(have a look at another SO question on how to install npm modules to see exactly where to install external npm modules.Here is an example that might help you out a bit, it scrapes the current time.
Server js
Client side script:
I hope this is helpful. amongst with Cheerio there are also other node frameworks such as node.io