Is it possible to send a DLQ when an S3 Upload fails ?

0

If a file upload to S3 fails for any reason, is there any way to send a failure message to DLQ ? As far as I know, it should not be possible, as file upload is happening outside of AWS. So, AWS does not have control over what happens, until the networking happens within AWS.

But, still, I want to know if I am wrong, and if it is possible to send a failure message to DLQ for File upload failures

1개 답변
2
수락된 답변

Correct, AB

You will just see the associated failure on the file upload itself.

i.e.,

upload failed: local\path\to\file to s3://bucket/remotepath Could not connect to the endpoint URL:

There are a few things you could try with aws cli config, to try and get around upload issues relating to concurrent requests & low bandwidth (by editing ~/aws/.config):

  • max_concurrent_requests - set this to a less ambitious number than the default 10 (maybe 5)
  • max_bandwidth - reduce this to a number slightly less than the upload speed aws s3 reports when using defaults (for example, if it's 1.2MB/s, try setting the value to 1MB/s)

S3 Multi-part Upload can also be leveraged, using AWS CLI.

If this helps confirm what you were thinking, please choose this as the Accepted Answer so others on re:Post may benefit - Thank you

profile pictureAWS
답변함 8달 전
profile picture
전문가
검토됨 7달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠