I'm making some research on the Hadoop framework. I would like to ask about the property that can be used in the framework.. For example
- io.sort.mb
- io.sort.record.percent
- etc
Is there any reference that I can can the whole properties list of this framework? Very hopefully that someone can help me.
Besides, I would like to ask if, is it any difference for io.sort.mb and mapreduce.task.io.sort.mb? Or they are just the same?
Here are complete list of configuration properties categorized by configuration files:
- Properties that go into core-site.xml
- Properties that go into hdfs-site.xml
- Properties that go into mapred-site.xml
- Properties that go into yarn-site.xml
And regarding your other question:
is it any difference for io.sort.mb and mapreduce.task.io.sort.mb? Or they are just the same?
There are the same, except that io.sort.mb
is deprecated from Hadoop 2.0.