EMR Serverless - Adding Custom Serde (jar file) for Hive Table

Question

Hi,
We are planning to make use of EMR Serverless Hive service to move one of our work load from EMR persistent cluster. This particular workload uses the external XML serde to define hive table. In the current environment, we copy the jar file from s3 location to /usr/lib/hive/lib/ location during the bootstrap.
With EMR Hive Serverless application, Is it possible to make use of custom serde for Hive? Let me know if you need more information.
Thanks for your help!

Answer

Hi,

Thank you for writing to RePost.

Yes, it is possible. You can use ADD JAR  in query file (or "initQueryFile") before the SerDe is used.

https://awscli.amazonaws.com/v2/documentation/api/latest/reference/emr-serverless/start-job-run.html

EMR Serverless - Adding Custom Serde (jar file) for Hive Table

Relevanter Inhalt