How can I use Node / Cheerio (or something else) t

2020-02-16 03:38发布

问题:

There is a global variable on a page that contains an object that I'd like to set up a scraper for. What's the best way to do this with Node / Express / potentially Cheerio?

I understand Cheerio's benefit in traversing a DOM, but I know the name of the global variable I want to scrape and just need to extract its information on a set schedule

回答1:

Cheerio is just a dom parser, so you wont have acces to any javascriot or any javascript generated content.

What you need is something like PhantomJS that simulates a browser. Have a look at this Stackoverflow answer