By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

How can I log byte-range information of Byte-Range fetches

0

Hi, I need to log S3 bucket access (PutObject, GetObject operations) history. One important feature I have to log in to the logging result is Byte-Range information of the GetObject operations when they are byte-range fetches.

I tried two logging options that AWS provides: S3 Server Access Logging and CloudTrail. However, neither of them actually stores Byte-Range information when I tested with byte-range fetch operations. I think this information should be delivered to the S3 server in the requests' HTTP header, but it seems like even CloudTrail does not store that part of the header.

Please let me know if there is anything I can try more or any solution to log this enough information.

Thanks!

Topics
StorageDeveloper ToolsManagement & Governance
Tags
Amazon Simple Storage ServiceMonitoring & LoggingAWS CloudTrail
Language
English
Hojin
asked 9 months ago282 views
1 Answer
1

Hi,

  1. Using S3 Server access logs, you can look for the Bytes Sent field in your GetObject operations. https://docs.aws.amazon.com/AmazonS3/latest/userguide/LogFormat.html

  2. Using Athena, you should able to analyze the contents of the logs. https://repost.aws/knowledge-center/analyze-logs-athena

Thank you,

AWS
rajesh pichaimani
answered 9 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content