I want to use testmapredsort
for benchmarking sort in Hadoop. I am NOT using TeraSort now.
hadoop-*test*.jar
is supposed to contain the testmapredsort
class. But I do not see hadoop-*test*.jar
in Hadoop2
.
hadoop jar hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar testmapredsort /data/unsorted-data -sortOutput /data/sorted-data
In Hadoop 1,
testmapredsort
is launched fromAllTestDriver.java
, which was indeed in e.g.hadoop-test-1.2.1.jar
. In Hadoop 2, it's now in MapredTestDriver.java, which can be found inside ofhadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar