脚本宝典收集整理的这篇文章主要介绍了Incompatible Jackson version: 2.9.0,脚本宝典觉得挺不错的,现在分享给大家,也给大家做个参考。
配置完scala(2.11)和spark(2.2.0)的windows环境后,写了个worldcount案例。加入以下依赖,然后编写wordcount
<PRoPErties>
<spark-version>2.2.0</spark-version>
<scala-version>2.11</scala-version>
</properties>
<dependencies>
<!-- https://mvnreposITory.COM/artifact/org.apache.spark/spark-core -->
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_${scala-version}</artifactId>
<version>${spark-version}</version>
</dependency>
</dependencies>
import org.apache.spark.rdd.RDD
import org.apache.spark.{SparkConf, SparkContext}
/**
* @Author 晓风
* @Date 2021/10/8 22:37
* @Version 1.0
*/
object WorldCount {
def main(args: Array[String]): Unit = {
// 配置相关信息
val sparkConf:SparkConf = new SparkConf().setMaster("local").setAppName("wordCount")
// 获取上下文
val sc: SparkContext = new SparkContext(sparkConf)
/* // 读取文件
val lines: RDD[String] = sc.textFile("data/helloworld")
// 切分,flatmap
val worlds: RDD[String] = lines.flatMap(_.split(" "))
// map
val worldTuple: RDD[(String, Int)] = worlds.map((_, 1))
// reduce
val value: RDD[(String, Int)] = worldTuple.reduceByKey((_ + _))
// 打印
value.foreach(println)
*/
//hello scala
//hello java
//hello spark
//hello flink
//hello world
sc.textFile("data/helloworld").flatMap(_.split(" ")).map((_,1)).reduceByKey(_ + _).foreach(println)
// 关闭连接
sc.stop()
}
}
Caused by: java.lang.NoClaSSDefFoundError: com/fasterXMl/jackson/annotation/JsonMerge
<dependency>
<groupId>com.fasterxML.jackson.core</groupId>
<artifactId>jackson-databind</artifactId>
<version>2.9.0</version>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
<version>2.9.0</version>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
<version>2.9.0</version>
</dependency>
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.9.0
<dependency>
<groupId>com.fasterxml.jackson.module</groupId>
<artifactId>jackson-module-scala_2.11</artifactId>
<version>2.9.0</version>
</dependency>
```properties
<properties>
<spark-version>2.2.0</spark-version>
<scala-version>2.11</scala-version>
</properties>
<dependencies>
<!-- https://mvnrepository.com/artifact/org.apache.spark/spark-core -->
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_${scala-version}</artifactId>
<version>${spark-version}</version>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.module</groupId>
<artifactId>jackson-module-scala_2.11</artifactId>
<version>2.9.0</version>
</dependency>
</dependencies>
```
以上是脚本宝典为你收集整理的Incompatible Jackson version: 2.9.0全部内容,希望文章能够帮你解决Incompatible Jackson version: 2.9.0所遇到的问题。
本图文内容来源于网友网络收集整理提供,作为学习参考使用,版权属于原作者。
如您有任何意见或建议可联系处理。小编QQ:384754419,请注明来意。