Unable to upload to S3 bucket

0

Hello,

I have not been able to upload a file to an S3 bucket for a file of around 120GB. It used to work, but not anymore. Whenever I try, the transfer stops in the middle, very close to the end, with the following error:

upload failed: ../home/cebim/backup_local/comamigo_20240504.sql to s3://clinisul/comamigo_20240504.sql Could not connect to the endpoint URL: "https://clinisul.s3.sa-east-1.amazonaws.com/comamigo_20240504.sql?uploadId=SVTYNY3Ugrkj58gKIdDmzHA.FYRDzeNmT7Wv2O5l8HKXAB2cDFsUA5BZw_F4aQPtqnoHHlD.KBX7GeJpQuFLDG_yywxoewWIf_P96fexyW3NRs5aonmn0SZm5onZ5hqe&partNumber=6261"

I've already tried setting the "max_concurrent_requests" variable to 1, without success. I've already tried specifying the region in the command, but that didn't work either. I imagined that the Internet provider was blocking the connection due to the default being 10 simultaneous requests, but it didn't solve the problem. I have another client that I send a 35GB file that works, but the Internet provider is other. Can anyone shed some light on this?

Thanks.

2 Antworten
1
Akzeptierte Antwort
profile picture
EXPERTE
beantwortet vor einem Monat
profile picture
EXPERTE
überprüft vor einem Monat
  • I added the variables suggested in the mentioned post:

    max_attempts = 20 retry_mode = standard

    With this I was able to upload it manually once. We will see if the problem will actually be resolved as the script runs over the days.

    Thanks!

0

verify the parameters multipart_threshold, multipart_chunksize try to bump values and see. https://docs.aws.amazon.com/cli/latest/topic/s3-config.html use_accelerate_endpoint would help too.

profile pictureAWS
EXPERTE
SriniV
beantwortet vor einem Monat

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen