Using Nutch crawler with Solr

2019-01-31 02:32发布

Am I able to integrate Apache Nutch crawler with the Solr Index server?

Edit:

One of our devs came up with a solution from these posts

  1. Running Nutch and Solr
  2. Update for Running Nutch and Solr

Answer

Yes

3条回答
The star\"
2楼-- · 2019-01-31 02:33

It's still an open issue. If you're feeling adventurous you could try applying those patches yourself, although it looks like it's not so simple

查看更多
做自己的国王
3楼-- · 2019-01-31 02:46

If you're willing to upgrade to nutch 1.0 you can use the solrindex as described in this article by Lucid Imagination: http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/.

查看更多
Emotional °昔
4楼-- · 2019-01-31 02:56

nutch 2.x is designed to use solr as default. You can follow the steps in http://wiki.apache.org/nutch/Nutch2Tutorial, or a better instruction in the book "Web Crawling and Data Mining with Apache Nutch".

查看更多
登录 后发表回答