Do I need to create two kinesis delivery streams to send messages under two different paths in the same s3 bucket?

0

I have a lambda function which receives logs from cloudwatch using a subscription filter and has to send them to firehose to be delivered to an s3 bucket.

The same lambda function receives two kinds of logs. These two log formats need to be written into two different paths under the same s3 destination.

For eg.

1)Log type A should be stored under - /logTypeA directory.

2)Log type B should be stored under - /logTypeB directory.

I am using cdk to create the necessary firehose and s3 setup.

Do I need to create two different delivery streams - one for log type A and one for log type B or is there a way to do this using a single delivery stream ? Didn't find anything useful in the tech docs.

Naxi
preguntada hace 2 años509 visualizaciones
1 Respuesta
0

If you have some field whose value you can use to discriminate, you can use dynamic partitioning.

profile pictureAWS
EXPERTO
Tasio
respondido hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas