Glue job access opensearch serverless failed

0

I have setup a aws opensearch severless collection. I also enable vpc endpoint and allow access from a IAM role. I created a AWS glue job in the same VPC and use elasticsearch glue connector from marketplace. The glue is to write index to my opensearch. But i always got error saying, `An error occurred while calling o115.pyWriteDynamicFrame. Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'

  • Are you sure your Glue job has connectivity to that serverless cluster?, you could try to open an http connection in the code using Python "requests" to verify

  • I have a vpc endpoint setup. I can verify that there is connectivity between vpc subnet and opensearch serverless vpc endpoint.

  • I would check the connectivity from the Glue script, not all types of endpoints work correctly when Glue runs inside a VPC

已提問 1 年前檢視次數 713 次
1 個回答
0

You must change your elasticsearch or opensearch libraries to match the ES server's version.

AWS
vtjean
已回答 1 年前
  • opensearch serverless dones't have any version allow me to select.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南