AWS Glue job timeout when attempting HTTP to a glue api

0

I'm building a glue job for a data migration with schema changes and mappings between two RDS postgres DBs.

I'm getting an error connecting to glue apis.

AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to glue.eu-central-1.amazonaws.com:443 [glue.eu-central-1.amazonaws.com/3.67.142.3, glue.eu-central-1.amazonaws.com/35.158.201.117, glue.eu-central-1.amazonaws.com/52.57.253.25, glue.eu-central-1.amazonaws.com/52.28.109.221, glue.eu-central-1.amazonaws.com/18.158.248.119, glue.eu-central-1.amazonaws.com/3.124.130.34, glue.eu-central-1.amazonaws.com/18.158.243.101, glue.eu-central-1.amazonaws.com/18.192.226.225] failed: connect timed out

I've had a previous job working properly using the same iam role, so I'm not sure where to look to fix the issue. Appreciating any insights.

gefragt vor einem Jahr301 Aufrufe
1 Antwort
2
Akzeptierte Antwort

Add a Glue endpoint on your VPC, so you can use the catalog APIs
If it was working before maybe you were running on a VPC with internet access or no VPC at all.

profile pictureAWS
EXPERTE
beantwortet vor einem Jahr
profile picture
EXPERTE
überprüft vor 15 Tagen
  • Thanks. It seems to have fixed the error.

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen