Observing when try to fetch the files in S3 bucket rest api requests using request module in python

Question

By using python module requests, I am trying to fetch the files in given S3 bucket but observing

Steps I followed :
1> In python I imported import base64
2> I generated a string to sign, this consists of 'get', date, time and bucket name and encoded this string with UTF-8
3> Now I generated signature using base64.b64encode and given Mac of security credentials of access_key and secret_key
4> I kept bucket name and region in URL
5> I kept 'Authorization' with above generated signature and host as path in the header dict
6> now I did requests.get(url, headers=headers) with timeout

I am observing

Didier_Durand · Answer

Hi, the exact signature used by AWS service is SigV4.

It is described here: https://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-authenticating-requests.html

My advice is to use boto3 (python SDK for AWS services): it will sign the requests for you.

See https://aws.amazon.com/sdk-for-python/

If you really want to code SigV4 on you own, you can get inspired by boto3 source code at https://github.com/boto/botocore/blob/develop/botocore/auth.py

Hope it helps!

Didier

Observing <Response [403]> when try to fetch the files in S3 bucket rest api requests using request module in python

Relevanter Inhalt