3 個答案
- 最新
- 最多得票
- 最多評論
0
Looks like the parameters are correct.
已回答 9 個月前
That does look correct, you must have something that odd in your job (lots of people use Hudi like that). Do you have any connections? Maybe the issue is in the code call, have you tried using DataFrame?
0
Using a DataFrame works. If you can please report that the sample generated by the Visual tool that uses a DynamicFrame is buggy. Thanks
已回答 9 個月前
You are right, it doesn't handle the s3 sink correctly for streaming visual jobs, reported.
0
I checked also the classpath and it looks ok to me.
- Yes the example uses a Kafka connection as data source
- The job is generated by the Visual tool
- I will try using a dataframe
已回答 9 個月前
相關內容
- AWS 官方已更新 3 年前
- AWS 官方已更新 1 年前
- AWS 官方已更新 1 年前
- AWS 官方已更新 2 年前
Check the classpath on SparkUI, sounds the Hudi libraries are not added, which should happen if you did add the argument --datalake-formats=hudi