s3 parquet partitions load to redshift using COPY command

0

Hello,

I have folder called s3://bucket/redshift-backup-test/folder_fact_ads_spend/fact_ads_spend_test.parquet/ inside this there partitions like Market=AU,Market=US,Market=SG (all data in parquet format)

columns: date,market,price,quantity

I am trying to load this using COPY command into my redshift database where I have same columns .

But I am not able to copy the data and error is columns not matching ( file having 3 and db have 4)

I have tried to remove the "Market" field from db and it worked.

Now my question is how I can load "Market" field which is partition column to db also.

질문됨 2년 전2222회 조회
1개 답변
0

Hi, you can try using the FILLRECORD paramater - FORMAT PARQUET FILLRECORD; see this blog for more details - https://aws.amazon.com/blogs/big-data/part-1-introducing-new-features-for-amazon-redshift-copy/

profile pictureAWS
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠