- 최신
- 최다 투표
- 가장 많은 댓글
Thank you for reaching out to us. Firehose does have some latency due to buffering hints[1] in the service. Having Kinesis stream connector to kinesis analytics takes care of checkpoints/batching and this can be read by lambda and written to SNS. The architecture is as below:
Kinesis analytics --> Kinesis stream --> lambda --> SNS
Please refer to the below blog for example architecture : -- https://aws.amazon.com/blogs/big-data/building-a-real-time-notification-system-with-amazon-kinesis-data-streams-for-amazon-dynamodb-and-amazon-kinesis-data-analytics-for-apache-flink/
Please note that de-duplication should be done on consumer end. This can be done in lambda function in the above case. Let us know if you may have any other queries.
References
[1] https://docs.aws.amazon.com/firehose/latest/APIReference/API_BufferingHints.html
관련 콘텐츠
- AWS 공식업데이트됨 2년 전