Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

EMR Serverless - Adding Custom Serde (jar file) for Hive Table

0

Hi, We are planning to make use of EMR Serverless Hive service to move one of our work load from EMR persistent cluster. This particular workload uses the external XML serde to define hive table. In the current environment, we copy the jar file from s3 location to /usr/lib/hive/lib/ location during the bootstrap. With EMR Hive Serverless application, Is it possible to make use of custom serde for Hive? Let me know if you need more information. Thanks for your help!

Topics
Analytics
Tags
Amazon EMR Serverless
Language
English
asked 4 years ago1.1K views
1 Answer
0

Hi,

Thank you for writing to RePost.

Yes, it is possible. You can use ADD JAR <s3://bucket/path/to/serde.jar > in query file (or "initQueryFile") before the SerDe is used.

https://awscli.amazonaws.com/v2/documentation/api/latest/reference/emr-serverless/start-job-run.html

AWS
answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content