使用AWS re:Post即您表示您同意 AWS re:Post 使用条款
AWS re:Postre:Post

Glue Table and Athena: What if some files are compressed and others are not in S3, will it break anything?

0

I have a glue table specified that refers to a location in S3. I noticed that when Firehose puts data there in parquet format it might be not always compressed.

Will it cause issues for Glue table, crawler or Athena to access the data (both compressed and not compressed)?

主题
分析
标签
Amazon AthenaAmazon Data FirehoseAWS Glue
语言
English
hRed
已提问 6 个月前297 查看次数
1 回答
0
已接受的回答

parquet files are self descriptive, it's even possible to use different compression inside a file for different columns/pages. Therefore it should work, but since it's not the normal case, it's possible that some tool has a bug and assume a single code is used.

profile pictureAWS
专家
Gonzalo Herreros
已回答 6 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈，并能促进提问者的职业发展。

回答问题的准则

相关内容