EMR Serverless - Adding Custom Serde (jar file) for Hive Table

0

Hi, We are planning to make use of EMR Serverless Hive service to move one of our work load from EMR persistent cluster. This particular workload uses the external XML serde to define hive table. In the current environment, we copy the jar file from s3 location to /usr/lib/hive/lib/ location during the bootstrap. With EMR Hive Serverless application, Is it possible to make use of custom serde for Hive? Let me know if you need more information. Thanks for your help!

RamSet
demandé il y a 2 ans765 vues
1 réponse
0

Hi,

Thank you for writing to RePost.

Yes, it is possible. You can use ADD JAR <s3://bucket/path/to/serde.jar > in query file (or "initQueryFile") before the SerDe is used.

https://awscli.amazonaws.com/v2/documentation/api/latest/reference/emr-serverless/start-job-run.html

AWS
Sujay_M
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions