So I have set up a hadoop 2.6.0 cluster and I want to run a benchmark to test read a write throughput. I keep reading places that I can use TestDFSIO to do this, but I am not able to find a way to run this program on Hadoop version 2.6.0. Does anyone know how to run this test, or an alternative?
可以将文章内容翻译成中文,广告屏蔽插件可能会导致该功能失效(如失效,请关闭广告屏蔽插件后再试):
问题:
回答1:
HiBench has an implementation of DFSIO. You can find HiBench by clicking here.
回答2:
You can run TestDFSIO benchmark test in hadoop 2.6.0 by the following command:
$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-tests.jar TestDFSIO -write -nrFiles 10 -fileSize 100
For detailed description you can also visit http://researchbyomesh.blogspot.in/2015/12/running-benchmark-tests-in-hadoop.html