Hadoop的工作和任务服务器无法正常工作(Hadoop Job and Task Tracker

2019-10-29 20:57发布

当我开始的Hadoop作业服务器和任务跟踪器不工作。

我有两个电脑工作。 主 - furkanb @主192.168.2.135和slave- detay @从属192.168.2.250。

XML和hosts文件在2台电脑一样。

我已经写到控制台JPS。

JPS

15568 JPS 12126 SecondaryNameNode 11812的NameNode 11934的DataNode 12314的ResourceManager

我的主机文件

/ etc / hosts文件

127.0.0.1本地主机

127.0.1.1 ubuntu.ubuntu域的ubuntu

192.168.2.135主

192.168.2.250奴隶

核心的site.xml

<configuration>

<property>
   <name>fs.default.name</name>
   <value>hdfs://master:54310</value>
</property>

</configuration>

HDFS-site.xml中

<configuration>
<property>
   <name>dfs.replication</name>
   <value>2</value>
</property>
</configuration>

mapred-site.xml中

<configuration>

<property>
   <name>mapred.job.tracker</name>
   <value>master:54311</value>
</property>

<property>
   <name>mapreduce.framework.name</name>
   <value>yarn</value>
</property>

</configuration>

纱的site.xml

<configuration>
 <property>
 <name>yarn.nodemanager.aux-services</name>
 <value>mapreduce.shuffle</value>
 </property>
 <property>
 <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
 <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

主机:

的/ etc / hadoop的/主人furkanb @主

的/ etc / hadoop的/从站furkanb @主detay @从属

从机:

的/ etc / hadoop的/从站本地主机

当我写start-all.sh在控制台上:

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
14/04/09 14:52:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master]
master: starting namenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-namenode-master.out
furkanb@master: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-datanode-master.out
detay@slave: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-detay-datanode-slave.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-secondarynamenode-master.out
14/04/09 14:53:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-resourcemanager-master.out
furkanb@master: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-nodemanager-master.out
detay@slave: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-detay-nodemanager-slave.out

我能达到本地主机:50070和硕士:50070。 但我不能达到本地主机:50030或硕士:50030

Answer 1:

您正在使用的纱线不是经典的MapReduce。 你不能在这里找到的JobTracker。 对于检查运行的应用程序的状态,你需要使用资源管理器的HTTP端口。 即8088

看看下面的URL本地主机:8088



文章来源: Hadoop Job and Task Tracker not working