By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Glue job access opensearch serverless failed

0

I have setup a aws opensearch severless collection. I also enable vpc endpoint and allow access from a IAM role. I created a AWS glue job in the same VPC and use elasticsearch glue connector from marketplace. The glue is to write index to my opensearch. But i always got error saying, `An error occurred while calling o115.pyWriteDynamicFrame. Cannot detect ES version - typically this happens if the network/Elasticsearch cluster is not accessible or when targeting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'

  • Gonzalo Herreros EXPERT
    a year ago

    Are you sure your Glue job has connectivity to that serverless cluster?, you could try to open an http connection in the code using Python "requests" to verify

  • rePost-User-4946701
    a year ago

    I have a vpc endpoint setup. I can verify that there is connectivity between vpc subnet and opensearch serverless vpc endpoint.

  • Gonzalo Herreros EXPERT
    a year ago

    I would check the connectivity from the Glue script, not all types of endpoints work correctly when Glue runs inside a VPC

Topics
Networking & Content DeliveryAnalyticsDatabase
Tags
Amazon VPCAWS GlueAmazon OpenSearch Serverless
Language
English
rePost-User-4946701
asked a year ago692 views
1 Answer
0

You must change your elasticsearch or opensearch libraries to match the ES server's version.

AWS
vtjean
answered a year ago
  • rePost-User-4946701
    a year ago

    opensearch serverless dones't have any version allow me to select.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content