- Newest
- Most votes
- Most comments
When triggering an AWS Glue job from EC2 using the AWS CLI with SNI filtering through an Envoy proxy, you need to allow *.glue.ca-central-1.amazonaws.com rather than just glue.ca-central-1.amazonaws.com because AWS Glue uses multiple service endpoints with different subdomains.
The wildcard pattern is necessary because:
-
Multiple API endpoints: AWS Glue may route requests to different service endpoints that use subdomain prefixes. These could include regional variations or service-specific endpoints that handle different aspects of the Glue service operations.
-
Job execution infrastructure: When you start a job run using commands like
aws glue start-job-run, the service may need to communicate with various backend systems that use different subdomain prefixes under the main Glue domain. -
Service architecture: AWS services often use multiple subdomains for load balancing, redundancy, and separating different functional components of the service. Without the wildcard, your SNI filtering would block connections to these additional endpoints, causing job invocation failures.
By allowing *.glue.ca-central-1.amazonaws.com, you ensure that all necessary Glue service endpoints can be reached through your Envoy proxy, enabling successful job execution and management operations from your EC2 instance.
Sources
Generate test data using an AWS Glue job and Python - AWS Prescriptive Guidance
Relevant content
- AWS OFFICIALUpdated 7 months ago
