Redshift Serverless Copy Feature to load data from S3

Question

How can we check the logs of the copy feature while loading the data from S3 to Redshift serverless? AWS has not given access to STL_LOAD_ERRORS table for serverless because of this I am not able to check which files are loaded and which are not?

In addition to that, I also wanted to check whether Redshift serverless will allow the Auto-copy feature in production. As per the latest preview, the auto-copy is only available for provisioned clusters.

Answer

Hello,
For redshift serverless, you may check SYS_LOAD_HISTORY[1] to view details of COPY commands. Each row represents a COPY command with accumulated statistics for some of the fields. It contains both running and finished COPY commands
To view details of COPY command errors, you may refer to SYS_LOAD_ERROR_DETAIL[2] system view.

Redshift auto-copy feature is currently available as a preview for provisioned clusters only and not for serverless. However, this feature might be available in Serverless on GA

Reference Links: 
[1] SYS_LOAD_HISTORY: https://docs.aws.amazon.com/redshift/latest/dg/SYS_LOAD_HISTORY.html
[2] SYS_LOAD_ERROR_DETAIL: https://docs.aws.amazon.com/redshift/latest/dg/SYS_LOAD_ERROR_DETAIL.html

Answer

In serverless, the please refer to [SYS_LOAD_ERROR_DETAIL](!https://docs.aws.amazon.com/redshift/latest/dg/SYS_LOAD_ERROR_DETAIL.html). It provides details on COPY command errors.

AWS Support or your AWS account team are best suited to answer your second question. Please create a support case to get it answered

Redshift Serverless Copy Feature to load data from S3

Contenuto pertinente