When will Redshift be compatible with Apache Iceberg format?

3

Apache Iceberg is a table format designed for use in large-scale data processing systems like Apache Spark, Presto, and AWS Athena. It is designed to provide ACID transactions, scalable data management, and efficient data access.

As a user, it is conceptually much simple to maintain because metadata is managed by Itself. So no more manual ADD PARTITION or DELETE PARTITION.

Knowing that Iceberg is already compatible with many services of AWS (Athena, Glue, Presto using EMR), when will Redshift be compatible with Apache Iceberg format?

feita há um ano1963 visualizações
5 Respostas
2

At this time, there is no official announcement from AWS or the Amazon Redshift team regarding compatibility with the Apache Iceberg format. However, AWS is constantly updating its services to add new features and improve compatibility with other tools and technologies, so it is possible that Redshift may support Iceberg in the future. It's always a good idea to keep an eye on the official AWS documentation and announcements for updates on this topic.

AWS
respondido há um ano
AWS
ESPECIALISTA
avaliado há 10 meses
1
  • Big thanks to Amazon Web Services (AWS) for actively listening to our feedback!

1

This is also a feature which is make or break for our solution to use redshift, would be amazing if iceberg support is in the near future

respondido há um ano
1

Will add a +1 to this. We're ingesting data into our data lake using Fivetran. It satisfies our external vendor's use case, because that's how they consume our data, but our internal data analysts are forced to use Athena to query data. This isn't ideal, because all of our other data is in Redshift, so they are having to manually export the iceberg data.

respondido há um ano
1

Plus 1 again. All of the other major warehouse solutions (BigQuery, Snowflake namely) already support Iceberg tables. Redshift needs to accelerate their product offering to remain competitive

Todd
respondido há um ano

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas