how to get permanent IP address with AWS Glue so that it can be whitelisted in rds sg

0

Hello everyone,

There is use case that data engineer uses glue service of us-east-1 to connect and crawl data from awscn rds instance via rds public endpoint with JBDC method.

question: in order to security, we don't hope open all port in security group of the rds, we would like to add us-east-1 glue's permanent ip to security group(ip whitelist). what is the permanent ip about the glue? is it glue.us-east-1.amazonaws.com, glue-fips.us-east-1.amazonaws.com, also we queried all of us-east-1 IP it is too big and we can not find any description which one ip range belong to glue.


US East (N. Virginia) us-east-1 glue.us-east-1.amazonaws.com, glue-fips.us-east-1.amazonaws.com

已提问 1 年前1952 查看次数
2 回答
0

When you setup a Glue Data Catalog connection you can specify a VPC, Subnet and Security group if you want to connect to a resource which is within your vpc - Glue will then use ENI's within this vpc for the connection. You can use similar to talk to resources outside your vpc (eg aws CN), the subnet you use would need internet connectivity ie a nat gateway which can be given an Elastic IP which will be static/permanent. This Elastic IP can be used for your security group

AWS
专家
Peter_G
已回答 1 年前
0

Hi,

when you crawl a database you need first to define a Connection in the Glue Catalog. The Connection aside from defining the jdbc connection string will define the VPC , Subnet and security group that will be used by Glue to procure the ENI.

The VPC, subnet, and security group are inherited from the RDS instance. Hence you do not need to specify any IP just make sure the security group has a self referencing rule granting access to all TCP ports to makes sure Glue can function properly.

You can check this documentation page for further information.

see the following screenshots from the legacy connection page on how to create a connection and last a screenshot of the security group associated both with RDS and Glue Connection:

Enter image description here

Enter image description here

Enter image description here

Enter image description here

hope this helps

AWS
专家
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则