Apache NiFi For Importing Data From RDMBS to HDFS

2019-08-23 11:42发布

问题:

We are exploring Apache NiFi as a general purpose data ingestion tool for our enterprise requirements.

One typical data ingestion requirement is moving data from RDBMS systems to HDFS.

I was able to build RDBMS to HDFS data movement flow in NiFi using GenerateTableFetch and ExecuteSQL Processors provided by NiFi and everything worked fine for smaller tables.

But, I couldn't test the flow for bigger tables as I was using a standalone distribution.

Has anyone done a performance comparison of NiFi with SQOOP for similar requirements ?

标签: apache-nifi