Include request_datetime from S3 file in Athena table - table made by Glue

0

In my early steps on the S3, Glue and Athena services, I managed to create a table with Glue, with respect some parquet files in an S3 bucket. Every 30 minutes a new parquet file, with same columns, is added to a folder in S3.

The first time that Glue created the table there was a request_datetime column (additional to the data of the parquet files) with the datetime of the push to the S3 folder and in this way I could filter in Athena for rows with respect to the request datetime, so it was helpful.

Some hours later, I cleaned my S3 bucket and wanted to start clean, but this time the table created from Glue didn't include this column.

So the question is: How can I include this column with this information about the request_datetime?

The request_datetime is part of the filename that is pushed to the s3 every 30 minutes but I think it is also available from the request data.

Thanks in advance for any assistance :)

回答なし

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン