欢迎访问 生活随笔!

生活随笔

当前位置: 首页 > 编程资源 > 编程问答 >内容正文

编程问答

记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history)

发布时间:2025/7/14 编程问答 37 豆豆
生活随笔 收集整理的这篇文章主要介绍了 记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history) 小编觉得挺不错的,现在分享给大家,帮大家做个参考.

说明:在ssh,用root用户登录到header(master)机器上,手工执行以下命令进行业务调试。

常用命令:

1. env  (忘记是大写ENV,还是小写env,来查看环境变量)

2. cat /etc/hosts (查看EMR集群机器的hostname ip配置)

3. 在header机器上,切换到hadoop用户后,可以 ssh@emr-worker-1 直接登录到worker-1机器上,因为集群的机器,hadoop用户已经配置互相信任关系。


启动:

###start zk su hadoop -c "/usr/lib/zookeeper-current/bin/zkServer.sh start" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/zookeeper-current/bin/zkServer.sh start"; done###start hdfs su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh start namenode" su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh start secondarynamenode" for i in `seq 1 2`; dosu hdfs -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/hadoop-daemon.sh start datanode"; done###start yarn su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh start resourcemanager" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/yarn-daemon.sh start nodemanager"; donesu hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh start proxyserver"###start mapreduce historyserver su hadoop -c "/usr/lib/hadoop-current/sbin/mr-jobhistory-daemon.sh start historyserver"


停止:
###stop spark su hadoop -c "/usr/lib/spark-current/sbin/stop-history-server.sh"###stop mapreduce historyserver su hadoop -c "/usr/lib/hadoop-current/sbin/mr-jobhistory-daemon.sh stop historyserver"###stop yarn su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh stop proxyserver"for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/yarn-daemon.sh stop nodemanager"; done su hadoop -c "/usr/lib/hadoop-current/sbin/yarn-daemon.sh stop resourcemanager"###stop hdfs for i in `seq 1 2`; dosu hdfs -c "ssh emr-worker-${i} /usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop datanode"; done su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop secondarynamenode" su hdfs -c "/usr/lib/hadoop-current/sbin/hadoop-daemon.sh stop namenode"###stop zk su hadoop -c "/usr/lib/zookeeper-current/bin/zkServer.sh stop" for i in `seq 1 2`; dosu hadoop -c "ssh emr-worker-${i} /usr/lib/zookeeper-current/bin/zkServer.sh stop"; done

总结

以上是生活随笔为你收集整理的记录ALiYun EMR常用服务的手动启动和停止命令(hdfs/yarn/mr-jobhistory/zk/spark-history)的全部内容,希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错,欢迎将生活随笔推荐给好友。