Error reading Kinesis table in Zeppelin

0

My application writes text data to a Kinesis Stream using pipe symbol as field separator. I've defined a table in Glue and specified CSV with the | separator. It's defined as a 3 column table and each column is string. However, when running interactive queries in Zeppelin using %flink.ssql, it chucks the following errors:

Caused by: java.io.IOException: Failed to deserialize CSV row 'DBSERV-1-REPO1|2022-02-24 11:55:34|WARNING: Heavy swapping detected '.

Caused by: java.lang.RuntimeException: Row length mismatch. 3 fields expected but was 1.

If I test writing to Kinesis using comma as separator and set the Glue table as CSV with comma separator, the query works correctly and I can read the data. Do I have to separately instruct the Zeppelin Note when the separator is not a comma?

已提問 2 年前檢視次數 61 次
沒有答案

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南