how to get permanent IP address with AWS Glue so that it can be whitelisted in rds sg

0

Hello everyone,

There is use case that data engineer uses glue service of us-east-1 to connect and crawl data from awscn rds instance via rds public endpoint with JBDC method.

question: in order to security, we don't hope open all port in security group of the rds, we would like to add us-east-1 glue's permanent ip to security group(ip whitelist). what is the permanent ip about the glue? is it glue.us-east-1.amazonaws.com, glue-fips.us-east-1.amazonaws.com, also we queried all of us-east-1 IP it is too big and we can not find any description which one ip range belong to glue.


US East (N. Virginia) us-east-1 glue.us-east-1.amazonaws.com, glue-fips.us-east-1.amazonaws.com

질문됨 일 년 전1954회 조회
2개 답변
0

When you setup a Glue Data Catalog connection you can specify a VPC, Subnet and Security group if you want to connect to a resource which is within your vpc - Glue will then use ENI's within this vpc for the connection. You can use similar to talk to resources outside your vpc (eg aws CN), the subnet you use would need internet connectivity ie a nat gateway which can be given an Elastic IP which will be static/permanent. This Elastic IP can be used for your security group

AWS
전문가
Peter_G
답변함 일 년 전
0

Hi,

when you crawl a database you need first to define a Connection in the Glue Catalog. The Connection aside from defining the jdbc connection string will define the VPC , Subnet and security group that will be used by Glue to procure the ENI.

The VPC, subnet, and security group are inherited from the RDS instance. Hence you do not need to specify any IP just make sure the security group has a self referencing rule granting access to all TCP ports to makes sure Glue can function properly.

You can check this documentation page for further information.

see the following screenshots from the legacy connection page on how to create a connection and last a screenshot of the security group associated both with RDS and Glue Connection:

Enter image description here

Enter image description here

Enter image description here

Enter image description here

hope this helps

AWS
전문가
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠