CloudWatch logs custom format

Question

Is it feasible to export CloudWatch logs to an s3 bucket in a certain format?
To be specific, I want the logs to be **.csv files in a GZIP format without a header**.

Answer

Hi,

You have a detailled walk-through of the entire process to export from logs from CloudWatch to S3 at https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/S3ExportTasksConsole.html

This page will also provide you with some advanced options:
* export those logs in an encrypted form 
* export the logs in a S3 bucket located in another account

You can than zip those logs via AWS CloudShell to avoid the setup of any  compute resource (ECS/Fargeate), EC2) : zip is part of pre-installed utilities in CloudShell. See https://docs.aws.amazon.com/cloudshell/latest/userguide/multiple-files-upload-download.html.

```
With the zip/unzip utilities, you can compress multiple files in an archive that can be 
treated as a single file. The utilities are pre-installed in the CloudShell compute environment.
```

Alternatively, you may want to give a try to AWS CloudWatch Log Insights to directly analyze your logs in place (i.e. in CloudWatch) and finally extract the minimum number of most interesting records. This video will show you how: https://www.youtube.com/watch?v=2s2xcwm8QrM

Best,

Didier

Answer

is there any option we can moved cloudwatch logs in to s3 and then we can read these logs same way as we query in cloudwatch insight ?

CloudWatch logs custom format

Relevant content