kerberos 下运行spark 报错 Requested user hdfs is banned
生活随笔
收集整理的這篇文章主要介紹了
kerberos 下运行spark 报错 Requested user hdfs is banned
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
啟動運行報錯
main : run as user is hdfs main : requested yarn user is hdfs Requested user hdfs is bannedFailing this attempt. Failing the application.ApplicationMaster host: N/AApplicationMaster RPC port: -1queue: root.defaultstart time: 1565170753121final status: FAILEDtracking URL: http://xxx:8088/cluster/app/application_1565170276877_0003user: hdfs 19/08/07 17:39:15 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1565170276877_0003 Exception in thread "main" org.apache.spark.SparkException: Application application_1565170276877_0003 finished with failed statusat org.apache.spark.deploy.yarn.Client.run(Client.scala:1025)at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1072)at org.apache.spark.deploy.yarn.Client.main(Client.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:730)at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)原因:CDH默認禁止hdfs用戶提交
總結
以上是生活随笔為你收集整理的kerberos 下运行spark 报错 Requested user hdfs is banned的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: C++面试/技巧(四)
- 下一篇: Turtlebot入门-配置网络