By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Issue with restoring files from S3 Glacier Deep Archive

0

Hi, I see issue with restoring files from S3 Glacier Deep Archive ONLY for us-east-1 Bucket arn:aws:s3:::client-documents-1 Object arn:aws:s3:::client-documents-1/1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png

If I try to do it via API here no warnings about that process is started:

[~] s3cmd restore --restore-days=30 --restore-priority=standard "s3://client-documents-1/1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png"
restore: 's3://client-documents-1/1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png'
[~] s3cmd restore --restore-days=30 --restore-priority=standard "s3://client-documents-1/1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png"
restore: 's3://client-documents-1/1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png'

If I do it via web console - I can Initiate restore. But here no status regarding the documentation https://docs.aws.amazon.com/AmazonS3/latest/userguide/restoring-objects.html

*You can check the progress of the restoration on the Object overview page. For more information, see Viewing an object overview in the Amazon S3 console. This page will show that the restoration is In progress. *

In eu-central-1 all works fine, only issue with buckets in us-east-1 region.

Topics
Storage
Tags
Amazon S3 GlacierStorage
Language
English
AWS-User-7993240
asked 2 years ago522 views
3 Answers
0

To check progress of the glacier restore, you can run the following command (S3 HeadObject):

aws s3api head-object --bucket your_bucket_here --key folder/testobject.obj

I'm not as familiar with s3cmd, you can do the same via CLI with:

aws s3api restore-object

The HeadObject command should give you the information you are looking for. You can also add the debug flag to the command to turn on debug logging: -debug

jsonc
answered 2 years ago
0

Please look into debug output in next messages:

aws s3api --debug --profile atlas restore-object --restore-request Days=30 --bucket client-documents-1 --key "1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png"

host;x-amz-content-sha256;x-amz-date
c5ab03906be18022d13d2db6f22121bb738fcb75dec4425a696d80df254e537a
2022-01-04 22:04:17,990 - MainThread - botocore.auth - DEBUG - StringToSign:
AWS4-HMAC-SHA256
20220104T200417Z
20220104/us-east-1/s3/aws4_request
9c87bf0b4ce7e00ba6cc0143dab5b26cb8089c92560d778a5ac144c4221f03be
2022-01-04 22:04:17,990 - MainThread - botocore.auth - DEBUG - Signature:
aa2a0eb5b2eabfa86d67a6d3abc55f52a89844d0f603378b222de53cfd1d09d4
2022-01-04 22:04:17,990 - MainThread - botocore.endpoint - DEBUG - Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=https://client-documents-1.s3.amazonaws.com/1-1607610920573_Screen%20Shot%202020-12-02%20at%2001.35.32.png?restore, headers={'User-Agent': b'aws-cli/2.2.41 Python/3.9.7 Darwin/20.3.0 source/x86_64 prompt/off command/s3api.restore-object', 'X-Amz-Date': b'20220104T200417Z', 'X-Amz-Content-SHA256': b'c5ab03906be18022d13d2db6f22121bb738fcb75dec4425a696d80df254e537a', 'Authorization': b'AWS4-HMAC-SHA256 Credential=XXXXX/20220104/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=aa2a0eb5b2eabfa86d67a6d3abc55f52a89844d0f603378b222de53cfd1d09d4', 'Content-Length': '96'}>
2022-01-04 22:04:17,991 - MainThread - botocore.httpsession - DEBUG - Certificate path: /usr/local/Cellar/awscli/2.2.41/libexec/lib/python3.9/site-packages/botocore/cacert.pem
2022-01-04 22:04:17,991 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): client-documents-1.s3.amazonaws.com:443
2022-01-04 22:04:19,030 - MainThread - urllib3.connectionpool - DEBUG - https://client-documents-1.s3.amazonaws.com:443 "POST /1-1607610920573_Screen%20Shot%202020-12-02%20at%2001.35.32.png?restore HTTP/1.1" 200 0
2022-01-04 22:04:19,031 - MainThread - botocore.parsers - DEBUG - Response headers: {'x-amz-id-2': 'voofNg9CJjGmXhAFgYLUc81kS/Z+sNs7yiKqVMJQCESACncfQMbhA5zg4WlwSUwusw3t1pMglEY=', 'x-amz-request-id': 'ATGKK2K4YAXJ8GTT', 'Date': 'Tue, 04 Jan 2022 20:04:19 GMT', 'Server': 'AmazonS3', 'Content-Length': '0'}
2022-01-04 22:04:19,031 - MainThread - botocore.parsers - DEBUG - Response body:
b''
2022-01-04 22:04:19,031 - MainThread - botocore.hooks - DEBUG - Event needs-retry.s3.RestoreObject: calling handler <bound method RetryHandler.needs_retry of <botocore.retries.standard.RetryHandler object at 0x10de2f340>>
2022-01-04 22:04:19,031 - MainThread - botocore.retries.standard - DEBUG - Not retrying request.
2022-01-04 22:04:19,031 - MainThread - botocore.hooks - DEBUG - Event needs-retry.s3.RestoreObject: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x10de2f3d0>>
2022-01-04 22:04:19,031 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.RestoreObject: calling handler <function enhance_error_msg at 0x1076961f0>
2022-01-04 22:04:19,031 - MainThread - botocore.hooks - DEBUG - Event after-call.s3.RestoreObject: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x10ddeaeb0>>
2022-01-04 22:04:19,031 - MainThread - awscli.formatter - DEBUG - RequestId: ATGKK2K4YAXJ8GTT
AWS-User-7993240
answered 2 years ago
0
2022-01-04 22:04:16,802 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.2.41 Python/3.9.7 Darwin/20.3.0 source/x86_64
2022-01-04 22:04:16,802 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['s3api', '--debug', '--profile', 'atlas', 'restore-object', '--restore-request', 'Days=30', '--bucket', 'client-documents-1', '--key', '1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png']
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_s3 at 0x107694f70>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_ddb at 0x1074da160>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.configure.configure.ConfigureCommand'>>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x107477700>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x10747c670>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function alias_opsworks_cm at 0x1076a9940>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_history_commands at 0x107528d30>
2022-01-04 22:04:16,824 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.devcommands.CLIDevCommand'>>
2022-01-04 22:04:16,825 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_waiters at 0x10769db80>
2022-01-04 22:04:16,825 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/Cellar/awscli/2.2.41/libexec/lib/python3.9/site-packages/awscli/data/cli.json
2022-01-04 22:04:16,827 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_types at 0x1075e49d0>
2022-01-04 22:04:16,827 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function no_sign_request at 0x1075e5550>
2022-01-04 22:04:16,827 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_verify_ssl at 0x1075e54c0>
2022-01-04 22:04:16,827 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_read_timeout at 0x1075e5670>
2022-01-04 22:04:16,827 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_connect_timeout at 0x1075e55e0>
2022-01-04 22:04:16,828 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <built-in method update of dict object at 0x107740680>
2022-01-04 22:04:16,828 - MainThread - botocore.session - DEBUG - Setting config variable for profile to 'atlas'
2022-01-04 22:04:16,828 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.2.41 Python/3.9.7 Darwin/20.3.0 source/x86_64 prompt/off
2022-01-04 22:04:16,828 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['s3api', '--debug', '--profile', 'atlas', 'restore-object', '--restore-request', 'Days=30', '--bucket', 'client-documents-1', '--key', '1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png']
2022-01-04 22:04:16,828 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_timestamp_parser at 0x1076965e0>
2022-01-04 22:04:16,828 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function register_uri_param_handler at 0x1071bb1f0>
2022-01-04 22:04:16,828 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_binary_formatter at 0x107706f70>
2022-01-04 22:04:16,829 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function no_pager_handler at 0x10717c3a0>
2022-01-04 22:04:16,829 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_assume_role_provider_cache at 0x1071e1ca0>
2022-01-04 22:04:16,831 - MainThread - botocore.utils - DEBUG - IMDS ENDPOINT: http://169.254.169.254/
2022-01-04 22:04:16,838 - MainThread - botocore.credentials - DEBUG - Skipping environment variable credential check because profile name was explicitly set.
2022-01-04 22:04:16,838 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function attach_history_handler at 0x107528c10>
2022-01-04 22:04:16,838 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_json_file_cache at 0x1074d8040>
2022-01-04 22:04:16,859 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/Cellar/awscli/2.2.41/libexec/lib/python3.9/site-packages/botocore/data/s3/2006-03-01/service-2.json
2022-01-04 22:04:16,870 - MainThread - botocore.hooks - DEBUG - Event building-command-table.s3api: calling handler <function add_waiters at 0x10769db80>
2022-01-04 22:04:16,890 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/Cellar/awscli/2.2.41/libexec/lib/python3.9/site-packages/botocore/data/s3/2006-03-01/waiters-2.json
2022-01-04 22:04:16,890 - MainThread - awscli.clidriver - DEBUG - OrderedDict([('bucket', <awscli.arguments.CLIArgument object at 0x10da5b5e0>), ('key', <awscli.arguments.CLIArgument object at 0x10da5b5b0>), ('version-id', <awscli.arguments.CLIArgument object at 0x10da5b550>), ('restore-request', <awscli.arguments.CLIArgument object at 0x10da5b520>), ('request-payer', <awscli.arguments.CLIArgument object at 0x10da5b4f0>), ('expected-bucket-owner', <awscli.arguments.CLIArgument object at 0x10da5b700>)])
2022-01-04 22:04:16,890 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.s3api.restore-object: calling handler <function add_streaming_output_arg at 0x1076968b0>
2022-01-04 22:04:16,890 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.s3api.restore-object: calling handler <function add_cli_input_json at 0x1071e84c0>
2022-01-04 22:04:16,891 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.s3api.restore-object: calling handler <function add_cli_input_yaml at 0x1071e8700>
2022-01-04 22:04:16,891 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.s3api.restore-object: calling handler <function unify_paging_params at 0x1074da790>
2022-01-04 22:04:16,911 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/Cellar/awscli/2.2.41/libexec/lib/python3.9/site-packages/botocore/data/s3/2006-03-01/paginators-1.json
2022-01-04 22:04:16,911 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.s3api.restore-object: calling handler <function add_generate_skeleton at 0x1075d8f70>
2022-01-04 22:04:16,911 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.s3api.restore-object: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputJSONArgument object at 0x10da5b7f0>>
2022-01-04 22:04:16,911 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.s3api.restore-object: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x10da5b820>>
2022-01-04 22:04:16,911 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.s3api.restore-object: calling handler <bound method GenerateCliSkeletonArgument.override_required_args of <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x10da5b8b0>>
2022-01-04 22:04:16,912 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.s3.restore-object.bucket: calling handler <awscli.paramfile.URIArgumentHandler object at 0x10778eaf0>
2022-01-04 22:04:16,912 - MainThread - botocore.hooks - DEBUG - Event process-cli-arg.s3.restore-object: calling handler <awscli.argprocess.ParamShorthandParser object at 0x1071a9fa0>
2022-01-04 22:04:16,912 - MainThread - awscli.arguments - DEBUG - Unpacked value of 'client-documents-1' for parameter "bucket": 'client-documents-1'
2022-01-04 22:04:16,912 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.s3.restore-object.key: calling handler <awscli.paramfile.URIArgumentHandler object at 0x10778eaf0>
2022-01-04 22:04:16,912 - MainThread - botocore.hooks - DEBUG - Event process-cli-arg.s3.restore-object: calling handler <awscli.argprocess.ParamShorthandParser object at 0x1071a9fa0>
2022-01-04 22:04:16,912 - MainThread - awscli.arguments - DEBUG - Unpacked value of '1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png' for parameter "key": '1-1607610920573_Screen Shot 2020-12-02 at 01.35.32.png'
AWS-User-7993240
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content