I want to cancel private CA Renewal. What should I do?

Unless it is already in expired or failed state, one must disable it before decommissioning it. Make sure you select the right restoration period in case of rollback. Refer to: https://docs.aws.amazon.com/privateca/latest/userguide/PCADeleteCA.html