transfer data from googlecloudstorage to AWS S3

Question

I'm transferring 1TB of data from google cloud storage to AWS s3. While using datasync service, I'm getting below error:

Failed to read metadata for file /pipeline.yml: S3 Head Object Failed
I have unchecked the copy tagwhile creating task and still getting it.

Answer

Hello,

This error indicates that AWS DataSync cannot read that file from the source GCS bucket.

An area to verify is the service account principal role that is associated with your HMAC key to ensure it has **Storage Object Viewer** permissions and does not contain IAM conditions that would prevent reading ```/pipeline.yml```.

https://docs.aws.amazon.com/datasync/latest/userguide/tutorial_transfer-google-cloud-storage.html

transfer data from googlecloudstorage to AWS S3

Relevant content