?

完整報錯如下:

$ spark-submit --class WordCountLocal --deploy-mode cluster ?--driver-memory 1g --executor-memory 1g --executor-cores 1 ?/home/appleyuchi/IdeaProjects/scala-learn/target/scala-learn-1.0-SNAPSHOT.jar
Running Spark using the REST application submission protocol.
20/04/26 21:48:35 WARN RestSubmissionClient: Unable to connect to server spark://master:7077.
Warning: Master endpoint spark://master:7077?was not a REST server. Falling back to legacy submission gateway instead.
Exception in thread "main" org.apache.spark.SparkException: Exception thrown in awaitResult:?
?? ?at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
?? ?at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:75)
?? ?at org.apache.spark.rpc.RpcEnv.setupEndpointRefByURI(RpcEnv.scala:101)
?? ?at org.apache.spark.rpc.RpcEnv.setupEndpointRef(RpcEnv.scala:109)
?? ?at org.apache.spark.deploy.ClientApp$$anonfun$7.apply(Client.scala:238)
?? ?at org.apache.spark.deploy.ClientApp$$anonfun$7.apply(Client.scala:238)
?? ?at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
?? ?at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
?? ?at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
?? ?at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
?? ?at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
?? ?at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
?? ?at org.apache.spark.deploy.ClientApp.start(Client.scala:238)
?? ?at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:894)
?? ?at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198)
?? ?at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228)
?? ?at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137)
?? ?at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.IOException: Failed to connect to master/192.168.0.103:7077
?? ?at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
?? ?at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
?? ?at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
?? ?at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
?? ?at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
?? ?at java.util.concurrent.FutureTask.run(FutureTask.java:266)
?? ?at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
?? ?at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
?? ?at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 連線被拒絕: master/192.168.0.103:7077
?? ?at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
?? ?at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
?? ?at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
?? ?at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
?? ?at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
?? ?at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
?? ?at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
?? ?at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
?? ?at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
?? ?at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
?? ?... 1 more
Caused by: java.net.ConnectException: 連線被拒絕
?? ?... 11 more
?

解決方案:

spark-defaults.conf設(shè)置好:

spark.master ? ? ? ? ? ? ? ? ? ? spark://master:7077

?

start-master.sh -h master

?

再次執(zhí)行:

$ spark-submit --class WordCountLocal --deploy-mode cluster ?--driver-memory 1g --executor-memory 1g --executor-cores 1 ?/home/appleyuchi/IdeaProjects/scala-learn/target/scala-learn-1.0-SNAPSHOT.jar
Running Spark using the REST application submission protocol.

報錯消失
?

?

參考:

https://blog.csdn.net/ybdesire/article/details/70666544
?

總結(jié)

以上是生活随笔為你收集整理的WARN RestSubmissionClient: Unable to connect to server spark://master:的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。