Generally, a CloudFormation stack gets stuck in the UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS state when CloudFormation is still in the process of removing old resources, or can't remove those resources due to a dependency issue.
In most cases, CloudFormation wait for resources to delete until it reaches to resource stabilization time before its timeout. Once it will be timed out, stack should move to UPDATE_ROLLBACK_COMPLETE.
You can also refer to KC article for some more information and resolutions.
Hope above was useful to resolve to the issue.
Stack deletion stuck as DELETE_IN_PROGRESSasked 2 years ago
CF stack stuck in cleanupasked 3 years ago
Stack stuck at CREATE_IN_PROGRESS for 12 days nowasked 10 months ago
CFM stack is stuck after failure deleting Beanstalk appAccepted Answerasked 4 months ago
CFN Stack stuck at UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESSasked a month ago
CloudFormation stack stuck in UPDATE_COMPLETE_CLEANUP_IN_PROGRESSAccepted Answerasked 8 months ago
Cloudformation Stack stuck in Update_Rollback_Failed State because of nested stack Update_Rollback_Failedasked 5 months ago
Cloudformation Stack Stuck in UPDATE_IN_PROGRESSasked 2 years ago
Stuck on UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS stateasked 5 days ago
Stack stuck on UPDATE_ROLLBACK_IN_PROGRESS statusasked 4 years ago