2 Answers
- Newest
- Most votes
- Most comments
0
Hi.
I understand that you want to process CloudFront real-time logs with MSK.
Kinesis is the only destination for CloudFront real-time logs.
As far as I can see, there is no managed mechanism to connect from Kinesis to MSK.
Therefore, I think you need to create a program that connects CloudFront real-time logs to Kinesis, creates your own consumer from there, and sends it to MSK, referring to the following.
Please refer to the following.
https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/real-time-logs.html
0
If it is a must to use MSK to gather logs from a Cloudfront distribution, then You could:
- use a combination of Kinesis DataStream/Firehose to send real time logs from Cloudfront. (https://aws.amazon.com/blogs/networking-and-content-delivery/cloudfront-realtime-logs/).
- Use or create your own Kafka connector (https://docs.confluent.io/kafka-connectors/kinesis/current/overview.html) to pull data from Kinesis to a Kafka topic.
Relevant content
- asked 5 years ago
- asked 8 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 2 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 3 years ago