spark异常java.lang.NoSuchMethodError: scala.Predef$.refArrayOps

spark | 2019-09-13 10:02:39

开发spark程序出现异常：

java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;


用Maven创建了一个spark sql项目，在引入spark sql jar包时引入的是：

  <dependency>
      <groupId>org.apache.spark</groupId>
      <artifactId>spark-sql_2.11</artifactId>
      <version>2.1.0</version>
    </dependency>

spark-sql_2.11：这个jar包是在scala2.11的版本上编译的，但是我在项目中引入的scala编译器是scala2.12.1的。所以就出错了。把编译器版本换成和spark-sql_2.11版本一致即可


登录后即可回复 登录 | 注册
    
相关文章
java或scala 类型转换 object integer long double string bigdecimal 互转 安全的方法scala编译异常ambiguous reference to overloaded definitionspark on hive 异常 `hivefileformat` doesn t match `parquetfileformat`java连接操作hadoop hdfs异常 nosuchmethoderror rpc.getproxyspark操作hive orc transactional事务表异常解决spark hive插入数据异常spark currently does not populate bucketed outputjava jdbc通过spark连接hive 异常required field client protocol is unsetmysql异常java.math.biginteger cannot be cast to java.lang.long解决spark异常 could not locate executable null bin winutils.exe in the hadoop binariesspark hive 元数据异常 filenotfoundexceptionspark java读写mysql数据库hive异常relative path in absolute uri ${system java.io.tmpdir}解决spark异常caused by java.util.concurrent.timeoutexception futures timed outspark 开发 常见异常处理解决spark shell 写入hbase 异常job in state define instead of runningspark rdd写入数据到hbase nullpointerexception异常spark异常java.lang.nosuchmethoderror scala.predef$.refarrayopsjava jdbc连接phoenix hbase异常clientpath null serverpath null finished falsescala与java语法差异scala 异常处理try、catch和final子句
关注编程学问公众号