Al usar AWS re:Post, aceptas las AWS re:Post Términos de uso
AWS re:Postre:Post

Glue job access opensearch serverless failed

0

I have setup a aws opensearch severless collection. I also enable vpc endpoint and allow access from a IAM role. I created a AWS glue job in the same VPC and use elasticsearch glue connector from marketplace. The glue is to write index to my opensearch. But i always got error saying, `An error occurred while calling o115.pyWriteDynamicFrame. Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'

  • Gonzalo Herreros EXPERTO
    hace un año

    Are you sure your Glue job has connectivity to that serverless cluster?, you could try to open an http connection in the code using Python "requests" to verify

  • rePost-User-4946701
    hace un año

    I have a vpc endpoint setup. I can verify that there is connectivity between vpc subnet and opensearch serverless vpc endpoint.

  • Gonzalo Herreros EXPERTO
    hace un año

    I would check the connectivity from the Glue script, not all types of endpoints work correctly when Glue runs inside a VPC

Temas
Redes y entrega de contenidoAnálisisBase de datos
Etiquetas
Amazon VPCAWS GlueAmazon OpenSearch Serverless
Idioma
English
rePost-User-4946701
preguntada hace un año713 visualizaciones
1 Respuesta
0

You must change your elasticsearch or opensearch libraries to match the ES server's version.

AWS
vtjean
respondido hace un año
  • rePost-User-4946701
    hace un año

    opensearch serverless dones't have any version allow me to select.

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas

Contenido relevante