S3DistCp on a bucket with Requester Pays

0

Is there a way to use s3-dist-cp to copy files from a bucket that uses Requestor payments?

preguntada hace 4 meses281 visualizaciones
2 Respuestas
0

Please find the example for requester pay model s3-dist-cp --src=s3://[requester-pays-bucket]/[path] --dest=s3://[destination-bucket]/[path] You need to replace request-paybucketname and destinationbucket as above commands.

Since you are the requester, you will be billed for data transfer and request costs. Ensure that you are aware of the pricing implications.

profile picture
Jagan
respondido hace 4 meses
0

Hi,

Because requesters are charged for downloading data from Requester Pays buckets, the requests must contain a special parameter, x-amz-request-payer, which confirms that the requester knows that they will be charged for the download. To do this, if you are utilizing EMRFS, you can set fs.s3.useRequesterPaysHeader to true in /usr/share/aws/emr/emrfs/conf/emrfs-site.xml. Or, setting fs.s3a.requester.pays.enabled: true with S3A connector. You can also refer to this article for another example.

I hope this helps.

AWS
respondido hace 3 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas