Kinesis Firehose to Redshift serverless support

2

Hi, We are currently using Kinesis Firehose to Redshift. I'm looking into migrating to Redshift Serverless. However, it seems there is no support in Firehose to connect to my Redshift Serverless. Will this be added soon?

Thanks.

asked 2 years ago1628 views
4 Answers
1

Hello,

Amazon Kinesis Data Firehose can now deliver streaming data to Amazon Redshift Serverless. Please check out the Press Release below

https://aws.amazon.com/about-aws/whats-new/2023/06/amazon-kinesis-data-firehose-data-stream-delivery-redshift-serverless/

profile pictureAWS
EXPERT
Jag
answered 9 months ago
  • thank you for the update - it's great! few follow up questions -

    1. in terms of pricing - how can i evaluate the 2 options (serverless vs provisioned), assuming we are constantly writing data to redshift via firehose sources?
    2. are there maintenance windows on redshift serverless (similar to what we have in provisioned clusters) that cause downtime to read\write data?
    3. is there a way to convert an existing fireshose delivery stream which is configured to provisioned cluster to redshift serverless location? we couldn't see it when we tried to edit the firehose destination config...

    thanks again!

  • Hey! Is there any ETA on when it will be available on CloudFormation / CDK ? Ty

0

Hello :) are there any news about support Kinesis Firehose Destination for Redshift Serverless? Thanks

answered a year ago
0

In terms of pricing - how can i evaluate the 2 options (serverless vs provisioned), assuming we are constantly writing data to redshift via firehose sources?

Amazon Redshift Serverless shines with workloads that have downtime so that you can take advantage of cost with the pay as you go model. For 24/7 workloads where the cluster is constantly active, you will get better price / performance with a redshift Provisioned cluster with Reserved Instance pricing

are there maintenance windows on redshift serverless (similar to what we have in provisioned clusters) that cause downtime to read\write data?

There is no maintenance window with Amazon Redshift Serverless. Software version updates are automatically applied. There's no interruption for existing connection or query execution when Amazon Redshift switches versions. New connections will always connect and work with Amazon Redshift Serverless instantly.

https://docs.aws.amazon.com/redshift/latest/mgmt/serverless-known-issues.html#:~:text=Maintenance%20window%20%E2%80%93%20There,Redshift%20Serverless%20instantly.

is there a way to convert an existing fireshose delivery stream which is configured to provisioned cluster to redshift serverless location? we couldn't see it when we tried to edit the firehose destination config

No, currently there are no options to directly edit an existing firehose delivery stream destination mapped to Redshift provisoned to Redshift Serverless

profile pictureAWS
EXPERT
Jag
answered 9 months ago
-1

Hi there, Redshift Serverless doesn't support Public Endpoint yet. But for delivery from Kinesis Data Firehose to Amazon Redshift, only publicly accessible Amazon Redshift clusters are supported. So in order to connect to Redshift Serverless from KFH, public endpoint support must be included. I will raise a feature request with the service team on your behalf. While I am unable to comment on if/when this feature may get released, I request you to keep an eye on our What's New (1) and Blog pages (2) for any new feature announcements.

(1) https://aws.amazon.com/new/

(2) https://aws.amazon.com/blogs/aws/

AWS
SUPPORT ENGINEER
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions