The auxService:mapreduce_shuffle does not exist

Question

When I am trying to run the below command:

# sqoop import --connect jdbc:mysql://IP Address/database --username root --password PASSWORD --table table_name --m 1

for importing the data from mysql database to HDFS, I am getting the error:

The auxService:mapreduce_shuffle does not exist.

Searched and browsed many sites, nothing helped.

How to get rid of this issue? Please let me know if any more inputs are required.

Answer 1

Its an entry that you are missing in yarn-site.xml. Apply those entries in both namenodes and datanodes. If you read this http://dataheads.wordpress.com/2013/11/21/hadoop-2-setup-on-64-bit-ubuntu-12-04-part-1/ , you will see that yarn-site.xml must have this entries:

 <property>
     <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>

Be careful when you write aux-services, because the "-" in the middle it's probably getting you that problem.