Year wrongly set to 2022 for AWS Kinesis Firehose Delivery Stream to S3

0

AWS Region: ap-southeast-1

Currently I am using the AWS Kinesis Firehose Delivery Stream to Stream the Cloudwatch Logs to S3 with the Prefix appending Timestamp, like this /year=!{timestamp:YYYY}/month=!{timestamp:MM}/day=!{timestamp:dd}/hour=!{timestamp:HH}/

However, found that after 25 Dec 2021, the Log File to S3 was wrongly put the Object to e.g. /year=2022/month=12/day=26/hour=00 now.

Anyone has the same issue now, looks critical issue for us as we use this timestamp for Partitioning on AWS Athena

asked 2 years ago416 views
1 Answer
0
Accepted Answer

Hello Keith,

The Amazon Kinesis Firehose Delivery Stream uses Java DateTimeFormatter.

Amazon Kinesis Firehose Delivery Stream: The timestamp namespace

y means year-of-era / Y means Week-based-year

Please use "year=!{timestamp:yyyy}" instead of "year=!{timestamp:YYYY}".

Thank you

AWS
Sean_P
answered 2 years ago
AWS
EXPERT
reviewed 2 years ago
  • Oh, thanks for remind on using the Java DateTimeFormatter, let me update the CloudFormation and see the case can be resolved.

    Thanks Sean!

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions