How do I scale my AWS EMR cluster with 1 master an

2019-09-11 02:38发布

I have implemented a cluster using AWS EMR. I have a master ndoe with 2 core nodes with hadoop bootstrap action. Now, I would like to use autoscaling and adjust the cluster size dynamically based on cpu threshold and some other constraints. BUt, I have no idea as there isn't much information on the web on how to use AutoScaling on already existing cluster. Any help.

1条回答
成全新的幸福
2楼-- · 2019-09-11 03:33

Currently you can't launch a EMR CLuster in a AutoScaling Group. But you can achieve a very similar goal by delivering your CloudWatch alarms notification to an SQS queue and a script consuming from that queue that uses AWS CLI or SDK to modify the cluster.

查看更多
登录 后发表回答