Durch die Nutzung von AWS re:Post stimmt du den AWS re:Post Nutzungsbedingungen
AWS re:Postre:Post

DataBrew - Iceberg Tables Support

0

Hello, I would like to know if there is a way to query Iceberg tables (backed with S3 parquet files) cataloged within the AWS Glue Catalog using AWS Databrew. (maybe through Athena?).

Also, is it possible to update an Iceberg table as output of a DataBrew job?. Regards

Themen
Analysen
Tags
Amazon AthenaAWS Glue DataBrewAWS Glue
Sprache
English
Miguel Garcia
gefragt vor 4 Monaten563 Aufrufe
2 Antworten
1
Akzeptierte Antwort

You can use a Glue Studio visual job, that uses Iceberg as the source and then a DataBrew recipe node to process the data.
In the same way you can get the output of the recipe node and store it using an Iceberg target node.

profile pictureAWS
EXPERTE
Gonzalo Herreros
beantwortet vor 4 Monaten
0

Thank you for your quick answer. Regarding the solution my concern is how to build the Databrew recipe. If Databrew is unable to directly connect to Iceberg tables, I assume you are force to use mock data or previously download the data from Iceberg. Am I correct or there is another better way to do that? Thanks

Miguel Garcia
beantwortet vor 4 Monaten
  • Gonzalo Herreros EXPERTE
    vor 4 Monaten

    I believe the Glue Studio data preview should work as well on recipes. Otherwise you could export sample data as you say and use the DataBrew editor if you prefer, and then use the recipe in Studio

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen

Relevanter Inhalt