When will Redshift be compatible with Apache Iceberg format?

3

Apache Iceberg is a table format designed for use in large-scale data processing systems like Apache Spark, Presto, and AWS Athena. It is designed to provide ACID transactions, scalable data management, and efficient data access.

As a user, it is conceptually much simple to maintain because metadata is managed by Itself. So no more manual ADD PARTITION or DELETE PARTITION.

Knowing that Iceberg is already compatible with many services of AWS (Athena, Glue, Presto using EMR), when will Redshift be compatible with Apache Iceberg format?

已提問 1 年前檢視次數 1972 次
5 個答案
2

At this time, there is no official announcement from AWS or the Amazon Redshift team regarding compatibility with the Apache Iceberg format. However, AWS is constantly updating its services to add new features and improve compatibility with other tools and technologies, so it is possible that Redshift may support Iceberg in the future. It's always a good idea to keep an eye on the official AWS documentation and announcements for updates on this topic.

AWS
已回答 1 年前
AWS
專家
已審閱 10 個月前
1
  • Big thanks to Amazon Web Services (AWS) for actively listening to our feedback!

1

This is also a feature which is make or break for our solution to use redshift, would be amazing if iceberg support is in the near future

已回答 1 年前
1

Will add a +1 to this. We're ingesting data into our data lake using Fivetran. It satisfies our external vendor's use case, because that's how they consume our data, but our internal data analysts are forced to use Athena to query data. This isn't ideal, because all of our other data is in Redshift, so they are having to manually export the iceberg data.

已回答 1 年前
1

Plus 1 again. All of the other major warehouse solutions (BigQuery, Snowflake namely) already support Iceberg tables. Redshift needs to accelerate their product offering to remain competitive

Todd
已回答 1 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南