Why Namenode is not working in Hadoop given setup

2019-07-13 02:59发布

问题:

I want to establish HBase cluster of 2 nodes. For that I first establish Hadoop setup. It works fine. Namenode, Secondary namenode, datanode, Jobtracker, Tasktracker, all are working, but when I configure for Hbase, Namenode stucks. It does not work now. Can you tell me why this happening?

My questions

  1. When hadoop is working, and over that when I configure Hbase. It only shows one machine available. But it have to show two machine available, on http://hdmaster:60010/master-status.
  2. When I stop all the services, then start all , by using commands, ./start-dfs.sh , ./start-mapred.sh. Then it shows, namenode is not working. Why ?

I tried a lot, but I didn't understand why this happening. I think there may be a issue of version. Because the 0.94.2 version of hbase is used by the tutorial, from where I learnt all these.

I followed link1 and link2.

Please help me. Looking for your kind response.

Some information

OS = centOS 5.5
Java = java version "1.6.0_23"
Hadoop = 1.0.3
Hbase = hbase-0.94.6.1

xml configuration(hadoop) for master and slave are as follows,

core-site.xml

<property>
        <name>fs.default.name</name>
        <value>hdfs://hdmaster:54310</value>
</property>

hdfs-site.xml

<property>
        <name>dfs.replication</name>
        <value>2</value>
</property>
<property>
        <name>dfs.permission</name>
        <value>false</value>
</property>
<property>
        <name>dfs.name.dir</name>
        <value>/HADOOP/hadoop/hdfs-data-name</value>
</property>
<property>
        <name>dfs.data.dir</name>
        <value>/HADOOP/hadoop/hdfs-data</value>
</property>

mapred-site.xml

<property>
        <name>mapred.job.tracker</name>
        <value>hdmaster:54311</value>
</property>

xml configuration for hbase for master and slave are as follows

hbase-site.xml

<property>
        <name>hbase.rootdir</name>
        <value>hdfs://hdmaster:54310/user/hbase</value>
</property>
<property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
</property>
<property>
        <name>hbase.zookeeper.quorum</name>
        <value>hdmaster,hdslave</value>
</property>
<property>
        <name>hbase.zookeeper.property.datadir</name>
        <value>/HADOOP/hadoop/zookeeper</value>
</property>
<property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2222</value>
</property>

EDIT NO. 1

When I run following commands, sequentially,

./start-mapred.sh

./start-dfs.sh

./start-hbase.sh

Then, ./start-hbase.sh ,gives following output

[hadoop@jhamb bin]$ ./start-hbase.sh
hdmaster: starting zookeeper, logging to /usr/local/hbase-0.94.6.1/bin/../logs/hbase-hadoop-zookeeper-jhamb.adobe.intern.out
hdslave: starting zookeeper, logging to /usr/local/hbase-0.94.6.1/bin/../logs/hbase-hadoop-zookeeper-hdslave.out
starting master, logging to /usr/local/hbase-0.94.6.1/bin/../logs/hbase-hadoop-master-jhamb.adobe.intern.out
hdmaster: regionserver running as process 9551. Stop it first.
hdslave: regionserver running as process 5850. Stop it first.