Transferring data from AWS Kinesis data streams to AWS Redshift using AWS Glue

Question

I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?

Answer

With Redshift Streaming Ingestion, you can now directly consume data from Kinesis Data Streams from within your Redshift Cluster without needing to ETL through Glue Streaming. Is Glue mandatory or can you use this feature?

The feature is in Public Preview however and is expected to GA soon this year.

https://docs.aws.amazon.com/redshift/latest/dg/materialized-view-streaming-ingestion.html

Transferring data from AWS Kinesis data streams to AWS Redshift using AWS Glue

Relevanter Inhalt