spark异常java.lang.NoSuchMethodError: scala.Predef$.refArrayOps

spark | 2019-09-13 10:02:39

开发spark程序出现异常：

java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;


用Maven创建了一个spark sql项目，在引入spark sql jar包时引入的是：

  <dependency>
      <groupId>org.apache.spark</groupId>
      <artifactId>spark-sql_2.11</artifactId>
      <version>2.1.0</version>
    </dependency>

spark-sql_2.11：这个jar包是在scala2.11的版本上编译的，但是我在项目中引入的scala编译器是scala2.12.1的。所以就出错了。把编译器版本换成和spark-sql_2.11版本一致即可


登录后即可回复 登录 | 注册
    
相关文章
解决java.lang.outofmemoryerror java heap spacescala编译异常ambiguous reference to overloaded definitionspark on hive 异常 `hivefileformat` doesn t match `parquetfileformat`java连接操作hadoop hdfs异常 nosuchmethoderror rpc.getproxyjava hadoop异常no filesystem for scheme hdfsspark操作hive orc transactional事务表异常java jdbc通过spark连接hive 异常required field client protocol is unsetmysql异常java.math.biginteger cannot be cast to java.lang.long解决spark操作mongodb异常 cannot cast bsonvaluespark异常 could not locate executable null bin winutils.exe in the hadoop binariesspark hive 元数据异常 filenotfoundexception解决spark异常caused by java.util.concurrent.timeoutexception futures timed outspark 开发 常见异常处理spark异常java.lang.nosuchmethoderror scala.predef$.refarrayopsspark 异常 spark conf / hadoop conf bad substitutionspark hive 异常 could not connect to meta store using any of the uris providedjava jdbc连接phoenix hbase异常clientpath null serverpath null finished falsespark scala中 = 符号的使用场景scala java map转 scala mapspark运行异常Failed writing driver logs to dfs
关注编程学问公众号