SSIS Best Practices with Amazon Redshift

0

A Customer uses SSIS in their SQL Server environment to perform ETL. They would like to move to Amazon Redshift for all the value Redshift brings to data warehousing.

What are the best practices for integrating Redshift into a SSIS workflow?

AWS
preguntada hace 5 años755 visualizaciones
1 Respuesta
0
Respuesta aceptada

Customers coming from SQL Server might first start with an Amazon Redshift pilot:

  1. Create their first Redshift cluster (and secondary AWS things like AWS VPC subnet groups, Amazon S3 buckets, etc.).
  2. Load some sample data and get familiar with Redshift fundamentals (COPY command, zone mapping, etc.)
  3. Hook up their favorite BI tool to check for compatibility.

As they progress, they can load a bulk copy of data from their existing MSSQL database using AWS DMS so they can experiment with their existing data model, see how it performs in Redshift, find out changes in data types, changes to their queries (especially things like PIVOTs), etc.

Finally, when they are ready to start integrating their data sources directly into Redshift, they might find they don't need SSIS and they can explore cloud-native services such as Glue, or Marketplace offerings like Matillion. If there is a hard requirement for SSIS, I would recommend a 3rd party plugin called ZappySys. It handles the Redshift loading best practices (i.e. staging data in S3, using COPY commands on multiple files in S3, etc.).

Hope this helps!

AWS
respondido hace 5 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas