Thanks for reaching out. You can refer to this part of the CDK .NET reference for an example on how you can override the request and response parameters in order to add your custom headers. Please search for "Working with models" in the page if the link does not take you there directly.
Please check this out and let us know how you go.
Query HTTP Request Headers When Using Function URLs?Accepted Answerasked 2 months ago
CDK to add Http headers in the integration requestasked 24 days ago
Why aren't the HTTP headers passed from API Gateway to Step Functions?asked 7 months ago
Return a custom header from lambda authorizer in API-gateway (HTTP api)asked 2 months ago
http lambda authorizer external api callsasked 2 months ago
http authorizer lambda permissionsAccepted Answerasked 4 months ago
Websocket $connect route: headers and querystring empty on http integrationAccepted Answerasked 3 years ago
How to pass API Gateway authorizer context value as an HTTP headerasked a month ago
How to validate header values in the API Gateway request before the integrationAccepted AnswerEXPERTasked 2 years ago
Application Load Balancer doesn't send user claims in HTTP headersAccepted Answerasked 3 years ago