How can I implement exponential backoff and retries in KDA(running Flink 1.13)

0

I saw that in Flink 1.15, this was added(https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/state/task_failure_recovery/) but I need to handle the scenario of my source and sink(which are Kinesis Data Streams) going away(and returning a UnknownHostException). I know it's not a thing that will happen very often with KDS but we happened to run into this one time. Our Flink App is written in Java. I see several config constants but was thinking about making this exception recoverable and using this consumer config(SHARD_GETRECORDS_RETRIES). I'm not sure on the producer side(not sure if the KPL will do the retry for me).

profile picture
질문됨 2년 전286회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠