hadoop的web ui的8088端口打不开一例

首先jps看下，得到:

25013 Master
8599 SecondaryNameNode
8200 NameNode
8377 DataNode
9902 Jps
 

可以发现没有resourcemanager,也就是说yarn没有启动．

log路径:

/home/appleyuchi/bigdata/hadoop-2.7.7/logs/yarn-appleyuchi-resourcemanager-Desktop.log

log中报错如下:

2020-04-27 15:13:36,416 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
2020-04-27 15:13:36,606 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/core-site.xml
2020-04-27 15:13:36,704 INFO org.apache.hadoop.security.Groups: clearing userToGroupsMap cache
2020-04-27 15:13:36,746 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/yarn-site.xml
2020-04-27 15:13:36,767 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
    at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
    at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
    at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2020-04-27 15:13:36,769 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
    at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
    at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
    at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,771 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at Desktop/192.168.0.103
************************************************************/

调试的过程中还碰到下面的错误:

Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.

＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊

2020-04-27 16:11:57,674 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not se

最终会牵涉到Zookeeper,zookeeper要求运行的最低集群配置是3台，由于手头只有两台，所以没法搞．

 

所以最终解决方案是不要在yarn-site.xml中开启yarn.resourcemanager.ha.enabled:

<configuration> <!-- <property><name>yarn.resourcemanager.ha.enabled</name><value>true</value> </property> -->

 

总结

以上是生活随笔为你收集整理的hadoop的web ui的8088端口打不开一例的全部内容，希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错，欢迎将生活随笔推荐给好友。