Glue job access opensearch serverless failed

0

I have setup a aws opensearch severless collection. I also enable vpc endpoint and allow access from a IAM role. I created a AWS glue job in the same VPC and use elasticsearch glue connector from marketplace. The glue is to write index to my opensearch. But i always got error saying, `An error occurred while calling o115.pyWriteDynamicFrame. Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'

  • Are you sure your Glue job has connectivity to that serverless cluster?, you could try to open an http connection in the code using Python "requests" to verify

  • I have a vpc endpoint setup. I can verify that there is connectivity between vpc subnet and opensearch serverless vpc endpoint.

  • I would check the connectivity from the Glue script, not all types of endpoints work correctly when Glue runs inside a VPC

1 回答
0

You must change your elasticsearch or opensearch libraries to match the ES server's version.

AWS
vtjean
已回答 1 年前
  • opensearch serverless dones't have any version allow me to select.

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则