2 Respuestas
- Más nuevo
- Más votos
- Más comentarios
0
Eventually, I found out that I use incorrect writing method in this case
- Correct method: glueContext.write_dynamic_frame.from_catalog
- Incorrect method: glueContext.write_dynamic_frame.from_option
Quoted from docs
Writes a DynamicFrame using the specified catalog database and table name.
respondido hace un año
0
Once you register a location to be managed by LakeFormation, you should not use s3 permissions to handle it since it.
Now any client API trying to access that table needs to be LakeFormation away in order to be able to use the delegated access permissions, for instance DynamicFrame is able write into such table but not if you write directly to s3 or you use DataFrame.
Contenido relevante
- OFICIAL DE AWSActualizada hace 2 años
- OFICIAL DE AWSActualizada hace un año
The amazon-reviews-pds bucket is data source which is a publicly available. My lake (destination bucket) permissions not written in the policy and grant permissions via Lake Formation.
Actually, if both IAM and Lake Formation grants permission, the the Glue Role is still able to write to S3, but it is not best practice.