Glue Table and Athena: What if some files are compressed and others are not in S3, will it break anything?

I have a glue table specified that refers to a location in S3. I noticed that when Firehose puts data there in parquet format it might be not always compressed.

Will it cause issues for Glue table, crawler or Athena to access the data (both compressed and not compressed)?

主題

分析

標籤

Amazon Athena Amazon Data Firehose AWS Glue

語言

English

hRed

已提問 6 個月前檢視次數 297 次

1 個回答

最新
最多得票
最多評論

這些答案是否有幫助？支持正確答案，以幫助社區從您的知識中受益。

已接受的答案

parquet files are self descriptive, it's even possible to use different compression inside a file for different columns/pages. Therefore it should work, but since it's not the normal case, it's possible that some tool has a bug and assume a single code is used.

專家

Gonzalo Herreros

已回答 6 個月前

Glue Table and Athena: What if some files are compressed and others are not in S3, will it break anything?

相關內容