I have installed Hadoop and HDFS using this tutorial
http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html
Everything is fine.
I am also able to create directories and use them using
hadoop fs -mkdir /tmp
hadoop fs -mkdir /small
I can also say
hadoop fs -ls /
However I am following a tutorial in which the trainer does
hadoop fs -mkdir temp
hadoop fs -ls
now on my machine when I issue the above command it says
ls: `.': No such file or directory
In my training video the command hadoop fs -ls works perfectly. Why should I specify the "/"?
Also I am getting this warning in all my commands
13/12/28 20:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
But in my trainers video there is no such warning.
My configuration file is exactly as the tutorial above and I can also see all management UIs at
http://abhishek-pc:8042/
http://abhishek-pc:50070/
http://abhishek-pc:8088/
So my question is what is wrong with my configuration and why is my system behaving differently than the training video?
Well, your problem regarding ls: '.': No such file or directory
' is because, there is no home dir on HDFS for your current user. Try
hadoop fs -mkdir -p /user/[current login user]
Then you will be able to hadoop fs -ls
As per this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
, please see my answer at this question
First:
hdfs dfs -mkdir /user
then perform
hdfs dfs -mkdir /user/hduser
Solved this. Run hadoop fs -ls as hdfs user(not as root user). #su - hdfs.
I faced a similar type of problem during tutorial by hadoop form link-
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html
when i tried command - bin/hdfs dfs -put etc/hadoop input
, it says
mkdir: `input': No such file or directory
then problem solved by adding extra / to input and command should be -
bin/hdfs dfs -put etc/hadoop /input
This could also happen due to bad carriage return characters. Run `dos2unix' on all your hdfs executable (shell script) and if required all other related shell scripts as well.
First of all when you want for the first time to put something in your HDFS you should do this steps
hdfs fs -mkdir -p /user/nameuser(the name of user )
hdfs fs -put ~/file
after hdfs dfs -mkdir /user/[user name]
do :
hadoop fs -ls /
it's works form me !