spark SaveMode数据源写入模式

spark | 2019-09-13 10:02:39

整理一下spark SaveMode数据源写入模式，包括 异常 追加 覆盖 存在忽略


Scala/JavaAny LanguageMeaning
SaveMode.ErrorIfExists(default)"error" or "errorifexists"(default)

When saving a DataFrame to a data source, if data already exists, an exception is expected to be thrown

.如果存在就抛出异常

SaveMode.Append"append"

When saving a DataFrame to a data source, if data/table already exists, contents of the DataFrame are expected to be appended to existing data

.直接追加

SaveMode.Overwrite"overwrite"

Overwrite mode means that when saving a DataFrame to a data source, if data/table already exists, existing data is expected to be overwritten by the contents of the DataFrame

.覆盖数据

SaveMode.Ignore"ignore"

Ignore mode means that when saving a DataFrame to a data source, if data already exists, the save operation is expected to not save the contents of the DataFrame and to not change the existing data. This is similar to a CREATE TABLE IF NOT EXISTS in SQL

.数据已经存在就忽略，不做任何操作



登录后即可回复 登录 | 注册
    
相关文章
spark读取phoenix hbase table表数据到dataframe的三种方式比较scala spark withcolumn when 计算添加新列spark savemode数据源写入模式spark dataset写入hive表spark submit 性能参数优化配置spring boot mybatis 注解切换多数据源spark jdbc分区并发读取 mysql 大表解决spark shell 写入hbase 异常job in state define instead of runningspark rdd写入数据到hbase nullpointerexception异常spark读取hbase到rdd并转换为dataset 案例如何解决spark hive 权限不够的问题如何解决spark大量连续计算卡死的问题？mysql 选择sql模式php bzip2 函数 二进制安全地写入 bzip2 文件php mcrypt 函数 返回打开的模式的名称php pdostatement 为语句设置默认的获取模式。linux centos安装google chrome浏览器使用headless无头模式spark scala map转 rdd 转 dataframespark写入mongo 按多维度提取分层jsonspark sql累积求和 accumulative sum
关注编程学问公众号