S3DistCp on a bucket with Requester Pays

0

Is there a way to use s3-dist-cp to copy files from a bucket that uses Requestor payments?

已提问 4 个月前280 查看次数
2 回答
0

Please find the example for requester pay model s3-dist-cp --src=s3://[requester-pays-bucket]/[path] --dest=s3://[destination-bucket]/[path] You need to replace request-paybucketname and destinationbucket as above commands.

Since you are the requester, you will be billed for data transfer and request costs. Ensure that you are aware of the pricing implications.

profile picture
Jagan
已回答 4 个月前
0

Hi,

Because requesters are charged for downloading data from Requester Pays buckets, the requests must contain a special parameter, x-amz-request-payer, which confirms that the requester knows that they will be charged for the download. To do this, if you are utilizing EMRFS, you can set fs.s3.useRequesterPaysHeader to true in /usr/share/aws/emr/emrfs/conf/emrfs-site.xml. Or, setting fs.s3a.requester.pays.enabled: true with S3A connector. You can also refer to this article for another example.

I hope this helps.

AWS
已回答 3 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则