欢迎访问 生活随笔!

生活随笔

当前位置: 首页 >

kerberos 下运行spark 报错 Requested user hdfs is banned

发布时间:2024/8/23 46 豆豆
生活随笔 收集整理的这篇文章主要介绍了 kerberos 下运行spark 报错 Requested user hdfs is banned 小编觉得挺不错的,现在分享给大家,帮大家做个参考.

启动运行报错

main : run as user is hdfs main : requested yarn user is hdfs Requested user hdfs is bannedFailing this attempt. Failing the application.ApplicationMaster host: N/AApplicationMaster RPC port: -1queue: root.defaultstart time: 1565170753121final status: FAILEDtracking URL: http://xxx:8088/cluster/app/application_1565170276877_0003user: hdfs 19/08/07 17:39:15 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1565170276877_0003 Exception in thread "main" org.apache.spark.SparkException: Application application_1565170276877_0003 finished with failed statusat org.apache.spark.deploy.yarn.Client.run(Client.scala:1025)at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1072)at org.apache.spark.deploy.yarn.Client.main(Client.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:730)at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

原因:CDH默认禁止hdfs用户提交

总结

以上是生活随笔为你收集整理的kerberos 下运行spark 报错 Requested user hdfs is banned的全部内容,希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错,欢迎将生活随笔推荐给好友。