スキップしてコンテンツを表示

Parquet files in S3?

0

Parquet files in S3: When DMS writes out the file and places it in S3 and it shows in the listing, is the file complete and nothing else is going to be added to it? or can it be partially filled?

AWS

質問済み 3年前2214ビュー

2回答
1
承認された回答

When DMS writes a Parquet file, it typically completes the file writing process and places it in S3 as a complete file.

Once the Parquet file is written and listed in S3, it is considered a finalized and immutable object. Subsequent updates or additions to the file are not possible without overwriting the entire file. If new data needs to be added, a new Parquet file would typically be created.

It's worth noting that the behavior of DMS and how it writes files to S3 can vary depending on the specific configuration and settings used. However, in most cases, Parquet files written by DMS are complete and finalized upon being placed in S3.

エキスパート

回答済み 3年前

エキスパート

レビュー済み 4ヶ月前

0

The S3 will have processed files. If the data are processed properly by DMS then it will be in S3. There is no partially filled file in S3.

回答済み 3年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

関連するコンテンツ