欢迎访问 生活随笔!

生活随笔

当前位置: 首页 > 编程资源 > 编程问答 >内容正文

编程问答

SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope

发布时间:2024/8/23 编程问答 45 豆豆
生活随笔 收集整理的这篇文章主要介绍了 SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope 小编觉得挺不错的,现在分享给大家,帮大家做个参考.

SparkStreaming运行报错 

19/05/05 22:35:18 INFO SparkEnv: Registering OutputCommitCoordinator Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.$scope()Lscala/xml/TopScope$;at org.apache.spark.ui.jobs.AllJobsPage.<init>(AllJobsPage.scala:39)at org.apache.spark.ui.jobs.JobsTab.<init>(JobsTab.scala:38)at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:65)at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:82)at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:220)at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:162)at org.apache.spark.SparkContext.<init>(SparkContext.scala:452)

版本问题:

 之前将依赖写成了2.10 ,而我用的版本是2.11,修改解决

<dependency><groupId>org.scala-lang.modules</groupId><artifactId>scala-xml_2.11</artifactId><version>1.2.0</version></dependency><dependency><groupId>org.scala-lang</groupId><artifactId>scala-library</artifactId><version>${scala.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-core_2.11</artifactId><version>${spark.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-sql_2.11</artifactId><version>${spark.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-streaming_2.11</artifactId><version>${spark.version}</version><exclusions><exclusion><artifactId>scala-library</artifactId><groupId>org.scala-lang</groupId></exclusion></exclusions></dependency><dependency><groupId>org.scala-lang</groupId><artifactId>scala-library</artifactId><version>${scala.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-core_2.11</artifactId><version>${spark.version}</version></dependency>

 

总结

以上是生活随笔为你收集整理的SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope的全部内容,希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错,欢迎将生活随笔推荐给好友。