Problems with AMIs from Graviton3

Question

Hello,
For the last 4/5 days I've tried to spin up instances from AMIs created with Graviton3. The original OS is Ubuntu 20.04 and the image was created without any apparent problem. However, these AMIs haven't worked yet: the console keeps showing the instance as "initializing" and I cannot log in on the instance. I have completed this process literally hundreds of times with different combinations of instances and OSs, but never ran into this issue.
Thanks.
P.S. Just for completeness, I launched a c7g.medium with ALinux2 (which is not my usual choice), updated it, created a text file in the home directory, and created the AMI. It doesn't work either, same problem.

Answer

Thank you for reporting this. We are able to reproduce the issue, have identified the root cause, and are working on a fix. We'll update this post when the fix has been deployed.

In the meantime, we suggest creating AMIs on Graviton2 instances (c6g/m6g/r6g) as a workaround. These AMIs can be used on Graviton3 instances without issue.

Answer

While we work on a general fix, you can work around this by executing the following command before creating a AMI on the c7g instance which removes the the EFI Internal Shell from the valid boot options so when the AMI in started on a new instance it will boot via the default media path. After executing the below, either stop your instance and create the image or create the image directly (nominally resulting in an instance reboot). After the reboot you'll have to execute this one-liner again to successfully re-create the image a second time.

```
sudo efibootmgr -B -b `efibootmgr | grep "EFI Internal Shell" | sed -r 's/Boot0*([0-9]+).*/\1/'`
```

Problems with AMIs from Graviton3

Relevant content