当前位置:
首页 >
kerberos 下运行spark 报错 Requested user hdfs is banned
发布时间:2024/8/23
46
豆豆
生活随笔
收集整理的这篇文章主要介绍了
kerberos 下运行spark 报错 Requested user hdfs is banned
小编觉得挺不错的,现在分享给大家,帮大家做个参考.
启动运行报错
main : run as user is hdfs main : requested yarn user is hdfs Requested user hdfs is bannedFailing this attempt. Failing the application.ApplicationMaster host: N/AApplicationMaster RPC port: -1queue: root.defaultstart time: 1565170753121final status: FAILEDtracking URL: http://xxx:8088/cluster/app/application_1565170276877_0003user: hdfs 19/08/07 17:39:15 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1565170276877_0003 Exception in thread "main" org.apache.spark.SparkException: Application application_1565170276877_0003 finished with failed statusat org.apache.spark.deploy.yarn.Client.run(Client.scala:1025)at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1072)at org.apache.spark.deploy.yarn.Client.main(Client.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:730)at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)原因:CDH默认禁止hdfs用户提交
总结
以上是生活随笔为你收集整理的kerberos 下运行spark 报错 Requested user hdfs is banned的全部内容,希望文章能够帮你解决所遇到的问题。
- 上一篇: C++面试/技巧(四)
- 下一篇: Turtlebot入门-配置网络