1 réponse
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
Hello,
As per the doc there are only two ways to update the schema 1.getSink() and 2.from_catalog() automatically from an AWS Glue Job and your job needs to use the Iceberg connection or Iceberg jars.
getSink() does not support market place connections. Reference
from_catalog() needs to read the metadata like classification or connection from the existing iceberg table. However, if you are creating iceberg tables from Athena as shown here . This method does not work as well. Reference
So, the only way I could see is to use from_options() method and use Spark dataframes to write to your Iceberg table.
Schema evolution for Iceberg tables are documented here and using Athena here
Contenus pertinents
- demandé il y a un an
- demandé il y a un an
- demandé il y a 7 mois
- AWS OFFICIELA mis à jour il y a 9 mois
- AWS OFFICIELA mis à jour il y a un an
- AWS OFFICIELA mis à jour il y a 2 ans