Cloudformation stack deletion - unable to delete API Gateway domain

I have this template which creates the API Gateway custom domain. When I deploy my stack, custom domain gets created successfully, but it does not get deleted when I delete my stack.
I would expect my domain to get deleted when I delete the stack. Is this not the case?

Resources:
  ApiGatewayCustomDomain:
    Type: "AWS::ApiGateway::DomainName"
    Properties:
      CertificateArn: "arn:aws:acm:us-east-1:xxxxxxxx:certificate/46c23619-cea4-4ac2-b373-36401ecebc51"
      DomainName:  "mydomain.com"
      EndpointConfiguration:
        Types:
          - EDGE