How to delete files transferred successfully by Datasync?

Question

We want to transfer files from our data center to S3 using Datasync. Based on the documentation, apparently, datasync does not delete the file at the source after the data transfer is successful. What is the common practice followed to delete the files locally after they are successfully transferred?

Answer

DataSync does not provide an option to delete files from the source location. An option could be to configure the tasks log level to **Log all transferred objects, files, and folders**. CloudWatch would then contain a list of transferred and verified files that can be used to delete files on the source.

Here is a link to a blog that also discusses using CloudWatch logs to perform post-process activities on transferred files.
https://aws.amazon.com/blogs/storage/post-process-your-transferred-data-with-file-level-logging-in-aws-datasync/

How to delete files transferred successfully by Datasync?

Contenuto pertinente