Sending Cloudfront realtime logs to aws msk

0

Hi, I am creating a video-on-demand streaming data pipeline, where I am using an event-based tracking system to track how much the user has watched the video. In order to verify this data, we will need to track the user's CloudFront access logs, and we would want to add the real-time logs to AWS-MSK (Kafka), how to send the real-time logs of CloudFront to AWS-MSK (Kafka) ?

2回答
0

Hi.

I understand that you want to process CloudFront real-time logs with MSK.

Kinesis is the only destination for CloudFront real-time logs.
As far as I can see, there is no managed mechanism to connect from Kinesis to MSK.

Therefore, I think you need to create a program that connects CloudFront real-time logs to Kinesis, creates your own consumer from there, and sends it to MSK, referring to the following.

Please refer to the following.
https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/real-time-logs.html

profile picture
エキスパート
iwasa
回答済み 1年前
profile picture
エキスパート
レビュー済み 1ヶ月前
0

If it is a must to use MSK to gather logs from a Cloudfront distribution, then You could:

profile picture
エキスパート
回答済み 1年前
profile picture
エキスパート
レビュー済み 1ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ