Year wrongly set to 2022 for AWS Kinesis Firehose Delivery Stream to S3

Question

AWS Region: ap-southeast-1

Currently I am using the AWS Kinesis Firehose Delivery Stream to Stream the Cloudwatch Logs to S3 with the Prefix appending Timestamp, like this
/year=!{timestamp:YYYY}/month=!{timestamp:MM}/day=!{timestamp:dd}/hour=!{timestamp:HH}/

However, found that after 25 Dec 2021, the Log File to S3 was wrongly put the Object to e.g. /year=2022/month=12/day=26/hour=00 now.

Anyone has the same issue now, looks critical issue for us as we use this timestamp for Partitioning on AWS Athena

Accepted Answer

Hello Keith,

The Amazon Kinesis Firehose Delivery Stream uses [Java DateTimeFormatter](https://docs.oracle.com/javase/8/docs/api/java/time/format/DateTimeFormatter.html).

Amazon Kinesis Firehose Delivery Stream: [The timestamp namespace](https://docs.aws.amazon.com/firehose/latest/dev/s3-prefixes.html#timestamp-namespace)

y means year-of-era / Y means Week-based-year

Please use "year=!{timestamp:yyyy}" instead of "year=!{timestamp:YYYY}".

Thank you

Year wrongly set to 2022 for AWS Kinesis Firehose Delivery Stream to S3

相關內容