Redshift Serverless and external glue table

Question

Got this error when trying to insert from temp internal table to external table.

ERROR: Invalid DataCatalog response for external table "reportdb"."logs_aggregated": Cannot deserialize Table. Error: ----------------------------------------------- error: Assert code: 1000 context: esdbname != nullptr - esdbname = nullptr. query: 4268288[child_sequence:1] location: s3_credentials_helper.cpp:119 [ErrorId: 1-66a21205-469da10a0bd098d2761dc9bc]

Sometimes it works, so it is happening intermittently. I already checked the glue table parameters and definition i believe it is correct (even i did use the glue crawler to generate the glue definition)

Anyone know about this issue ?

Giovanni Lauria · Answer

This error seems to be related to a transient issue with AWS Glue's Data Catalog, which is responsible for managing the metadata of external tables like the one you're trying to access. The error message indicates that the Data Catalog response for the external table is invalid, and it cannot deserialize the table definition.

Try refreshing the Glue Data Catalog by running the MSCK REPAIR TABLE command on the external table. This can help synchronize the table's metadata with the Data Catalog.

Try refreshing the Glue Data Catalog by running the `MSCK REPAIR TABLE` command on the external table. This can help synchronize the table's metadata with the Data Catalog.

Redshift Serverless and external glue table

Relevant content