Redshift super datatype not enough to store json data type column from Postgres

We are encountering a issue where we're utilizing the "super" datatype. The column in the Parquet file we receive has a maximum length of 192K. How should we handle this data? Are there alternative datatypes we can use to accommodate such large data sizes?

主题

分析数据库

标签

AWS Glue 提取变换和加载数据 Amazon Redshift

语言

English

msve

已提问 1 个月前231 查看次数

1 回答

最新
投票最多
评论最多

这些答案有用吗？为正确答案投票，以帮助社区从您的知识中受益。

Is the parquet file the one you are ingesting? One option would be to keep the file as parquet and read it via Redshift Spectrum. https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html. You could then query it joined with all the other data in Redshift and not have make alterations to the file itself.

evaleah

已回答 1 个月前

专家

Osvaldo Marte

已审核 1 个月前

Redshift super datatype not enough to store json data type column from Postgres

相关内容