sudo yum update = HTTP Error 403 on Amazon Linux packages

Question

I am getting a 403 Forbidden HTTP error on all the Amazon Linux repositories I have configured on my EC2 instances. I didn't play with repos in quite a while; this started during the nightly packages update I have in a cron job.  
This is on an instance that has been running for years.  
I tried the mentioned URLs in a browser on my desktop, and they indeed return a 403.  
I even tried rebooting my EC2 instance!

```
$ cat /etc/os-release
NAME="Amazon Linux AMI"
VERSION="2018.03"
...

$ sudo yum clean all
Loaded plugins: auto-update-debuginfo, priorities, update-motd, upgrade-helper
Cleaning repos: amzn-main amzn-updates dockerrepo epel nodesource remi remi-php71 remi-safe
Cleaning up everything

$ sudo yum update
Loaded plugins: auto-update-debuginfo, priorities, update-motd, upgrade-helper
amzn-main                                                                                                                                                                  | 2.1 kB  00:00:00     
amzn-updates                                                                                                                                                               | 2.5 kB  00:00:00     
dockerrepo                                                                                                                                                                 | 2.9 kB  00:00:00     
epel/x86_64/metalink                                                                                                                                                       |  13 kB  00:00:00     
epel                                                                                                                                                                       | 3.2 kB  00:00:00     
nodesource                                                                                                                                                                 | 2.5 kB  00:00:00     
remi                                                                                                                                                                       | 2.9 kB  00:00:00     
remi-php71                                                                                                                                                                 | 2.9 kB  00:00:00     
remi-safe                                                                                                                                                                  | 2.9 kB  00:00:00     
(1/13): amzn-main/latest/group_gz                                                                                                                                          | 4.4 kB  00:00:00     
(2/13): amzn-updates/latest/group_gz                                                                                                                                       | 4.4 kB  00:00:00     
(3/13): amzn-updates/latest/updateinfo                                                                                                                                     | 525 kB  00:00:00     
(4/13): amzn-updates/latest/primary_db                                                                                                                                     | 876 kB  00:00:00     
(5/13): amzn-main/latest/primary_db                                                                                                                                        | 4.0 MB  00:00:00     
(6/13): epel/x86_64/group_gz                                                                                                                                               |  71 kB  00:00:00     
(7/13): dockerrepo/primary_db                                                                                                                                              | 3.3 kB  00:00:00     
(8/13): epel/x86_64/updateinfo                                                                                                                                             | 772 kB  00:00:00     
(9/13): epel/x86_64/primary                                                                                                                                                | 3.2 MB  00:00:00     
(10/13): nodesource/x86_64/primary_db                                                                                                                                      |  56 kB  00:00:00     
(11/13): remi-php71/primary_db                                                                                                                                             | 196 kB  00:00:01     
(12/13): remi-safe/primary_db                                                                                                                                              | 1.1 MB  00:00:01     
(13/13): remi/primary_db                                                                                                                                                   | 2.2 MB  00:00:01     
epel                                                                                                                                                                                  12516/12516
1746 packages excluded due to repository priority protections
Resolving Dependencies
--> Running transaction check
---> Package openssl-debuginfo.x86_64 1:1.0.2k-12.110.amzn1 will be updated
---> Package openssl-debuginfo.x86_64 1:1.0.2k-13.111.amzn1 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

==================================================================================================================================================================================================
 Package                                        Arch                                Version                                             Repository                                           Size
==================================================================================================================================================================================================
Updating:
 openssl-debuginfo                              x86_64                              1:1.0.2k-13.111.amzn1                               amzn-updates-debuginfo                              6.2 M

Transaction Summary
==================================================================================================================================================================================================
Upgrade  1 Package

Total download size: 6.2 M
Is this ok [y/d/N]: y
Downloading packages:
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.us-east-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
To address this issue please refer to the below knowledge base article

https://access.redhat.com/solutions/69319

If above article doesn't help to resolve this issue please open a ticket with Red Hat Support.

openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.us-west-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.us-west-2.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.eu-west-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.eu-central-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.ap-southeast-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.ap-northeast-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.ap-northeast-2.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.sa-east-1.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.
openssl-debuginfo-1.0.2k-13.11 FAILED                                          
http://packages.ap-southeast-2.amazonaws.com/2018.03/updates/7dba1463f962/debuginfo/x86_64/Packages/openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64.rpm?instance_id=i-xxxxxxxx&region=us-east-1: [Errno 14] HTTP Error 403 - Forbidden
Trying other mirror.


Error downloading packages:
  1:openssl-debuginfo-1.0.2k-13.111.amzn1.x86_64: [Errno 256] No more mirrors to try.
```

Edited by: Guillaume Boudreau on Nov 1, 2018 8:03 AM  
  
Edited by: Guillaume Boudreau on Nov 1, 2018 8:04 AM  
  
Edited by: Guillaume Boudreau on Nov 1, 2018 8:05 AM

Answer

I already had openssl-1.0.2k-12.110 installed; once I removed all the files & folders in /var/cache/yum/x86_64/latest/, 1.0.2k-13.111 was not listed as an available update anymore.

Answer

Thanks; that matches what I saw on my boxes.

Answer

Looks like I was able to resolve it using

```
sudo rm -rf /var/cache/yum/x86_64/latest/*
```

I think what happened is that I had a cache version of a broken repomd.xml, and
 `yum clean all`
 did not delete it.

Answer

Same think happened to me this morning. After I ran a 'yum clean all' yum stopped carping about updates.  
  
After that, however, it seems like I still have 'Package openssl.x86_64 1:1.0.2k-12.110.amzn1' installed and am not being offered 'Package openssl.x86_64 1:1.0.2k-13.111.amzn1'  
  
Were you offered 'Package openssl.x86_64 1:1.0.2k-12.110.amzn1' after running the 'yum clean' ???  
  
-RD  
  
Edited by: dickdefuria on Nov 1, 2018 9:16 AM

Answer

Update: this morning I was again offered "openssl.x86_64 1:1.0.2k-13.111.amzn1"  
  
And yum was able to successfully apply the update (i.e., no "\[Errno 14] HTTP Error 403 - Forbidden").  
  
Edited by: dickdefuria on Nov 2, 2018 4:24 AM

sudo yum update = HTTP Error 403 on Amazon Linux packages

Relevanter Inhalt