How can I implement exponential backoff and retries in KDA(running Flink 1.13)

0

I saw that in Flink 1.15, this was added(https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/state/task_failure_recovery/) but I need to handle the scenario of my source and sink(which are Kinesis Data Streams) going away(and returning a UnknownHostException). I know it's not a thing that will happen very often with KDS but we happened to run into this one time. Our Flink App is written in Java. I see several config constants but was thinking about making this exception recoverable and using this consumer config(SHARD_GETRECORDS_RETRIES). I'm not sure on the producer side(not sure if the KPL will do the retry for me).

profile picture
已提問 2 年前檢視次數 286 次
沒有答案

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南