I wanted to configure spark on my hortonwork cluster. I downloaded spark tar file and updated configuration on master and copied those configuration on slave machine.
I started my spark master successfully with below command.
./start-master.sh
but for stating slave it is asking for password.
Below are three files that i have updated
spark-defaults.conf
spark.master spark://masternode:7077
spark.serializer org.apache.spark.serializer.KryoSerializer
conf/slaves
hduser@slave1.bigdata
hdsuer@slave2.bigdata
spark-env.sh
SPARK_JAVA_OPTS=-Dspark.driver.port=53411
HADOOP_CONF_DIR=$HADOOP_HOME/conf
SPARK_MASTER_IP=hadoop-master.bigdatacoe
SPARK_WORKER_INSTANCES=4
SPARK_MASTER_WEBUI_PORT=8081
I am able to ssh to slave node without password but still while starting spark slaves , it is asking for password.
Please let me know what i am missing here.
Thanks in advance.