glacier.us-east-1.amazonaws.com timeouts during retrieval

Question

I'm trying to DOWNLOAD files from Glacier vaults at us-east-1 . RETRIEVE is submitted successfully, but after 4 hours, when I try to download the files, https and http connections to glacier.us-east-1.amazonaws.com timeout after about 60 seconds.
Retrieval/download jobs at us-west-1 work flawlessly.

sample request below:

"GET /-/vaults/vaultname/jobs/XXX/output HTTP/1.1\r
        TE: deflate,gzip;q=0.3\r
        Connection: TE, close\r
        Authorization: AWS4-HMAC-SHA256 Credential=X/20220414/us-east-1/glacier/aws4_request, SignedHeaders=host;x-amz-date;x-amz-glacier-version, Signature=X\r
        Host: glacier.us-east-1.amazonaws.com\r
        User-Agent: agent string\r
        X-Amz-Date: 20220414T205439Z\r
        X-Amz-Glacier-Version: 2012-06-01\r
        \r
       "

Accepted Answer

After dealing with helpless AWS support and trying everything I could think of, I discovered that the file couldn't be downloaded whole but could be downloaded in segments via by passing 'range:' header in the download call. I have no idea why glacier in different regions behaves differently and why it fails so miserably without any error messages in us-east-1. But I have to conclude that at this point I can not recommend using AWS Glacier to anyone. Use GCP instead - it works flawlessly every time and there is no annoying 4h retrieve window to wait.

glacier.us-east-1.amazonaws.com timeouts during retrieval

Relevanter Inhalt