Spark Installation | Unable to start spark slaves

2019-06-02 04:58发布

问题:

I wanted to configure spark on my hortonwork cluster. I downloaded spark tar file and updated configuration on master and copied those configuration on slave machine.

I started my spark master successfully with below command.

./start-master.sh

but for stating slave it is asking for password.

Below are three files that i have updated

spark-defaults.conf

spark.master spark://masternode:7077

spark.serializer org.apache.spark.serializer.KryoSerializer

conf/slaves

hduser@slave1.bigdata

hdsuer@slave2.bigdata

spark-env.sh

SPARK_JAVA_OPTS=-Dspark.driver.port=53411

HADOOP_CONF_DIR=$HADOOP_HOME/conf

SPARK_MASTER_IP=hadoop-master.bigdatacoe

SPARK_WORKER_INSTANCES=4

SPARK_MASTER_WEBUI_PORT=8081

I am able to ssh to slave node without password but still while starting spark slaves , it is asking for password.

Please let me know what i am missing here.

Thanks in advance.