Saltar al contenido

AWS Glue job timeout when attempting HTTP to a glue api

0

I'm building a glue job for a data migration with schema changes and mappings between two RDS postgres DBs.

I'm getting an error connecting to glue apis.

AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to glue.eu-central-1.amazonaws.com:443 [glue.eu-central-1.amazonaws.com/3.67.142.3, glue.eu-central-1.amazonaws.com/35.158.201.117, glue.eu-central-1.amazonaws.com/52.57.253.25, glue.eu-central-1.amazonaws.com/52.28.109.221, glue.eu-central-1.amazonaws.com/18.158.248.119, glue.eu-central-1.amazonaws.com/3.124.130.34, glue.eu-central-1.amazonaws.com/18.158.243.101, glue.eu-central-1.amazonaws.com/18.192.226.225] failed: connect timed out

I've had a previous job working properly using the same iam role, so I'm not sure where to look to fix the issue. Appreciating any insights.

preguntada hace 3 años757 visualizaciones

1 Respuesta
2
Respuesta aceptada

Add a Glue endpoint on your VPC, so you can use the catalog APIs
If it was working before maybe you were running on a VPC with internet access or no VPC at all.

AWS
EXPERTO

respondido hace 3 años

EXPERTO

revisado hace 2 años

  • Thanks. It seems to have fixed the error.

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.