Complete list of property that is used in Hadoop f

2019-03-01 05:04发布

问题:

I'm making some research on the Hadoop framework. I would like to ask about the property that can be used in the framework.. For example

  • io.sort.mb
  • io.sort.record.percent
  • etc

Is there any reference that I can can the whole properties list of this framework? Very hopefully that someone can help me.

Besides, I would like to ask if, is it any difference for io.sort.mb and mapreduce.task.io.sort.mb? Or they are just the same?

回答1:

Here are complete list of configuration properties categorized by configuration files:

  • Properties that go into core-site.xml
  • Properties that go into hdfs-site.xml
  • Properties that go into mapred-site.xml
  • Properties that go into yarn-site.xml

And regarding your other question:

is it any difference for io.sort.mb and mapreduce.task.io.sort.mb? Or they are just the same?

There are the same, except that io.sort.mb is deprecated from Hadoop 2.0.