Skip to content

Invoke glue job with SNI filtering configuration

0

I have to trigger a glue job from EC2 using aws CLI, I have SNI filtering setup using envoy proxy, why I need to add rule that allows *.glue.ca-central-1.amazonaws.com, and not only glue.ca-central-1.amazonaws.com

asked 17 days ago32 views
1 Answer
0
Accepted Answer

When triggering an AWS Glue job from EC2 using the AWS CLI with SNI filtering through an Envoy proxy, you need to allow *.glue.ca-central-1.amazonaws.com rather than just glue.ca-central-1.amazonaws.com because AWS Glue uses multiple service endpoints with different subdomains.

The wildcard pattern is necessary because:

  1. Multiple API endpoints: AWS Glue may route requests to different service endpoints that use subdomain prefixes. These could include regional variations or service-specific endpoints that handle different aspects of the Glue service operations.

  2. Job execution infrastructure: When you start a job run using commands like aws glue start-job-run, the service may need to communicate with various backend systems that use different subdomain prefixes under the main Glue domain.

  3. Service architecture: AWS services often use multiple subdomains for load balancing, redundancy, and separating different functional components of the service. Without the wildcard, your SNI filtering would block connections to these additional endpoints, causing job invocation failures.

By allowing *.glue.ca-central-1.amazonaws.com, you ensure that all necessary Glue service endpoints can be reached through your Envoy proxy, enabling successful job execution and management operations from your EC2 instance.
Sources
Generate test data using an AWS Glue job and Python - AWS Prescriptive Guidance

answered 17 days ago
AWS
EXPERT
reviewed 17 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.