catching S3 exceptions

Question

I have code like this using the S3 resource.  The client error exception is supposed to catch exceptions from that resource, but if my internet connection dies, it's not caught.  How do I know my code is set up to catch all the exceptions I need to catch?  This sounds like a basic question but I'm having a hard time figuring it out.  I look at the documentation and it says a client error will catch all the resource exceptions, but it doesn't.  Thanks for the help.

try:
      upload_file_response = s3.upload_file(source, destination, key, ExtraArgs=extra_args, Callback=callback, Config=config)

except botocore.exceptions.ClientError as err:
   	   print('
In ClientError') 
   	   print('
 source is %s' % (source)) 
   	   print('
Error Code: {}'.format(err.response['Error']['Code'])) 
   	   print('
Error Message: {}'.format(err.response['Error']['Message'])) 
   	   print('
Request ID: {}'.format(err.response['ResponseMetadata']['RequestId'])) 
   	   print('
Http code: {}'.format(err.response['ResponseMetadata']['HTTPStatusCode'])) 
   	   end_tstamp = datetime.now()
   	   print('End time is ', end_tstamp)
   	   duration = end_tstamp - tstamp
   	   print('Duration is ',str(duration).split('.')[0])    	   
   	   raise err

Accepted Answer

If you're looking to provide more details on the errors in ClientErrors, you can check the Error nested dictionary that appears with the ResponseMetadata nested dictionary.  One thing to keep in mind is that Boto3 classifies all AWS service errors and exceptions as ClientError exceptions as well.

However, if you're looking for exceptions while using a resource client, that may be slightly different as catching exceptions and errors is a similar experience to using a low-level client for certain AWS services.  For these, parsing may look different for error responses as you’ll need to access the client’s meta property to get to the exceptions such as client.meta.client.exceptions..

For more information, check out: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/error-handling.html

catching S3 exceptions

Relevant content