CDK constructs for Kinesis Delivery stream to consume from MSK topic

Question

As of Sept, 2023 kinesis firehose supports creating delivery stream to consume MSK Topic data and store that into s3 with partitioning.
https://aws.amazon.com/about-aws/whats-new/2023/09/amazon-msk-data-s3-kinesis-data-firehose/
Is there a way to configure this in CDK as well ?
Looking for some examples. Thanks

Answer

Create a MSK cluster using the MskConstruct:

```
const cluster = new Msk.Cluster(this, 'MyCluster', {
  // configuration 
});
Create a Firehose delivery stream using the FirehoseConstruct and specify the MSK cluster as the source:

const stream = new Firehose.CfnDeliveryStream(this, 'MyStream', {
  deliveryStreamType: 'KinesisStreamAsSource',
  kinesisStreamSourceConfiguration: {
    kinesisStreamArn: cluster.kinesisStreamArn,
    roleArn: // IAM role 
  }
});
```

Specify the S3 destination configuration for the stream.

Add appropriate IAM permissions and roles.

Deploy the CDK app.

CDK constructs for Kinesis Delivery stream to consume from MSK topic

相關內容