Got the answer for this from a kindly person on the Hudi slack channel.
The issue is with httpclient. By specifying a version when we passed in the jars, everything resolved:
Hope it helps someone else.
absolute lifesaver. the AWS Hudi docs do not specify the httpclient jar, only the other 2. thank you!!!!!!!!!!
Spark with scala 2.12.x on EMRasked 3 years ago
Can Data Pipelines be used for running Spark jobs on EMR 6.5.0?asked 8 months ago
Test session is no longer eligible for launch. I have problem with examasked 2 years ago
Hudi and S3 object versionsasked 7 months ago
Issue with Apache Hudi and MoR snapshot tablesasked 5 months ago
Example to building data lakehouse with Apache Hudiasked 2 months ago
AWS Glue Hudi Connector job with error 'hoodie only support org.apache.spark.serializer.KryoSerializer as spark.serializer'asked 3 months ago
No Such Method Error with Spark and Hudiasked 3 years ago
S3 Hudi Replication and Failoverasked 7 months ago
How can I display data with start and end date in QuickSight?asked 8 months ago