API Gateway CORS error after update aws-cdk update to 1.135.0

I have an http api gateway with a LambdaProxyIntegration, using python, aws-cdk v1.134.0

After trying to upgrade to v1.135.0, and changing it to HttpLambdaIntegration, I'm getting the following error.

Access to XMLHttpRequest at 'https://{domain}.execute-api.{region}.amazonaws.com/dev/v1/web/...' from origin 'https://localhost:3000' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: It does not have HTTP ok status.

I enabled logging on the for the API stage and I'm seeing the requests, but I'm not seeing the request get logged in the lambda logs. Also, my CORS configuration did not change.

Any advice on how to resolve this?