What is the alternative of Selenium for executing

2019-05-07 19:32发布

I want to execute JavaScript's function in Python-Scrapy, before, i used Selenium, but Selenium is too much slow for scraping the big sites.

I would like to know what's the best alternative for selenium for executing js in Scrapy?

1条回答
Lonely孤独者°
2楼-- · 2019-05-07 20:12

Splash - A javascript rendering service

Splash is a javascript rendering service with an HTTP API. It's a lightweight browser with an HTTP API, implemented in Python using Twisted and QT.

It's fast, lightweight and state-less which makes it easy to distribute.

Bonus points for it being developed by the same guys who are developing Scrapy.

查看更多
登录 后发表回答