Do I need to create two kinesis delivery streams to send messages under two different paths in the same s3 bucket?

0

I have a lambda function which receives logs from cloudwatch using a subscription filter and has to send them to firehose to be delivered to an s3 bucket.

The same lambda function receives two kinds of logs. These two log formats need to be written into two different paths under the same s3 destination.

For eg.

1)Log type A should be stored under - /logTypeA directory.

2)Log type B should be stored under - /logTypeB directory.

I am using cdk to create the necessary firehose and s3 setup.

Do I need to create two different delivery streams - one for log type A and one for log type B or is there a way to do this using a single delivery stream ? Didn't find anything useful in the tech docs.

Naxi
gefragt vor 2 Jahren509 Aufrufe
1 Antwort
0

If you have some field whose value you can use to discriminate, you can use dynamic partitioning.

profile pictureAWS
EXPERTE
Tasio
beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen