PARQUET argument is not supported when loading from file system

0

In the AWS documentation is states I should be able to COPY parquet files into Redshift. (https://aws.amazon.com/about-aws/whats-new/2018/06/amazon-redshift-can-now-copy-from-parquet-and-orc-file-formats/) I am having a dog of a time making this work.

After creating a role with S3ReadOnlyAccess, AWSGlueFullAccess, and AWSAthenaFullAccess, I trusted the role to the user account of Redshift. I then added the IAM role to the Redshift Cluster.

However after running the COPY command I received the error:
PARQUET argument is not supported when loading from file system

I am attempting to load it from an S3 location. Any idea why this error is being thrown? Is PARQUET not supported as an Importable file into Redshift from S3, or am I not giving the role the correct access to something?

Any help is appreciated.

Thanks,
Stephen.

Edited by: roland23571113 on Jun 8, 2018 6:47 PM

Edited by: roland23571113 on Jun 11, 2018 1:32 PM
I have attached a pointer to the documentation I read online. This does not work on my US-WEST-2 redshift cluster. https://aws.amazon.com/about-aws/whats-new/2018/06/amazon-redshift-can-now-copy-from-parquet-and-orc-file-formats/

Edited by: roland23571113 on Jun 12, 2018 10:50 AM
After discussing with the aws architect it appears the role settings are correct:
AWSS3ReadOnly
AWSGlueFullControl
AWSAthenaFullControl

Assigning trust of the Redshift user account to the role was done correctly.

Adding the role to the AWS Cluster was done correctly.

The copy command was the only thing done incorrectly.

The trick is that the S3 bucket path must point to a folder containing the .parquet file, not the file itself. Any file found in the folder is assumed to be uploaded as a parquet file.

copy <table_name>
from "<S3 Folder Path>
IAM_ROLE '<role string>'
FORMAT AS PARQUET

질문됨 6년 전1828회 조회
1개 답변
0

Answered by AWS Architect Review.

답변함 6년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠