By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Server Access Logging Bucket

0

Hi all, I was experimenting with server access logging and had a server access log bucket writing event notifications to an SQS queue during object creation events. the workflow resembles the following:

S3 Test bucket (Server Access Logging enabled) -> S3 access log destination Bucket -> SQS queue

To test the queue, I had uploaded an object to the log bucket (not the test bucket). I expected 2 messages to appear on the queue, the test message and the object upload event message. To my surprise, there were more than 2 messages that appeared in my queue, and there were many log files created in my log bucket. Does anyone know the reason behind this? I am not familiar with reading the log objects but I do see some get ownership, get intelligent tiering and get notification requests among the object files.

Thanks all!

Topics
StorageServerlessApplication Integration
Tags
Amazon Simple Storage ServiceAmazon Simple Queue Service
Language
English
Paul
asked 2 years ago306 views
2 Answers
0

Server Access logging provides details for the requests that are made to a bucket. It logs the request information in log files where each line is a record. For more information you can refer to below link for more info and log format details:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/ServerLogs.html https://docs.aws.amazon.com/AmazonS3/latest/userguide/LogFormat.html

Logging also be done through CloudTrail and it provides lot of other information. https://docs.aws.amazon.com/AmazonS3/latest/userguide/cloudtrail-logging.html

S3 Event notification is used to receive notifications when certain events happen in your S3 bucket like object creation. https://docs.aws.amazon.com/AmazonS3/latest/userguide/NotificationHowTo.html

If you have setup Event notification on your log bucket for any new object creation in log bucket, they may be notifications for new objects created i.e. log files or any object you manually upload to the log bucket. Looking into the lot files can help to give more insight.

AWS
rePostfanclub
answered 2 years ago
  • Paul
    2 years ago

    Hm I did not set up event notification or server access logging on my log bucket, so when I created an object in my log bucket, I was confused why new log files were created in that same log bucket. The log bucket is the destination bucket for another s3 bucket that has server access logging enabled.

0

You are seeing the results of a distributed system. The API calls do not land on a single location.

profile pictureAWS
Rodney Lester
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content