When will Redshift be compatible with Apache Iceberg format?

3

Apache Iceberg is a table format designed for use in large-scale data processing systems like Apache Spark, Presto, and AWS Athena. It is designed to provide ACID transactions, scalable data management, and efficient data access.

As a user, it is conceptually much simple to maintain because metadata is managed by Itself. So no more manual ADD PARTITION or DELETE PARTITION.

Knowing that Iceberg is already compatible with many services of AWS (Athena, Glue, Presto using EMR), when will Redshift be compatible with Apache Iceberg format?

demandé il y a un an1971 vues
5 réponses
2

At this time, there is no official announcement from AWS or the Amazon Redshift team regarding compatibility with the Apache Iceberg format. However, AWS is constantly updating its services to add new features and improve compatibility with other tools and technologies, so it is possible that Redshift may support Iceberg in the future. It's always a good idea to keep an eye on the official AWS documentation and announcements for updates on this topic.

AWS
répondu il y a un an
AWS
EXPERT
vérifié il y a 10 mois
1
  • Big thanks to Amazon Web Services (AWS) for actively listening to our feedback!

1

This is also a feature which is make or break for our solution to use redshift, would be amazing if iceberg support is in the near future

répondu il y a un an
1

Will add a +1 to this. We're ingesting data into our data lake using Fivetran. It satisfies our external vendor's use case, because that's how they consume our data, but our internal data analysts are forced to use Athena to query data. This isn't ideal, because all of our other data is in Redshift, so they are having to manually export the iceberg data.

répondu il y a un an
1

Plus 1 again. All of the other major warehouse solutions (BigQuery, Snowflake namely) already support Iceberg tables. Redshift needs to accelerate their product offering to remain competitive

Todd
répondu il y a un an

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions