使用AWS re:Post即您表示您同意 AWS re:Post 使用条款
AWS re:Postre:Post

how to config athena spark by use dynamic partition mode when overwrite

0

I want to save parquet file to s3 by partition mode default is not dynamic and the old data will be erased . How can I config athena spark session setting to dynamic mode?

主题
分析
标签
Amazon Athena会话管理
语言
English
rePost-User-8379266
已提问 1 年前301 查看次数
1 回答
0

Hello,

This could have been addressed by setting "spark.sql.sources.partitionOverwriteMode" to "dynamic". But as of today, Athena Spark does not allow to make any changes to the spark config.

AWS
Sachin_KV
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈，并能促进提问者的职业发展。

回答问题的准则

相关内容