Image scraping in Ruby

2019-05-12 14:56发布

How do I scrape an image present on a particular URL using Nokogiri? If there are better options than Nokogiri please suggest. The css image tag is .profilePic img

2条回答
2楼-- · 2019-05-12 15:41

If it is just an <img> with a URL:

PAGE = "http://site.com/page.html"
require 'nokogiri'
require 'open-uri'
html = Nokogiri.HTML(open(PAGE))
src  = html.at('.profilePic img')['src']
File.open("foo.png", "wb") do |f|
  f.write(open(src).read)
end

If you need to turn a relative image path into an absolute, see:
https://stackoverflow.com/a/4864170/405017

查看更多
We Are One
3楼-- · 2019-05-12 15:41

The lazy way is to use mechanize as it will figure out the urls and filenames for you:

require 'mechanize'
agent = Mechanize.new
doc = agent.get(url)
agent.get(doc.parser.at('.profilePic img')['src']).save
查看更多
登录 后发表回答