- Newest
- Most votes
- Most comments
Hi Salman,
The error message indicates that the field named "werk" in the Parquet file has a data type of BINARY, but the corresponding column in the Glue catalog table schema is defined as an integer. The root cause of the issue is the mismatch between the Parquet file schema and the Glue table schema. Check the schema of the Parquet file generated by Job 1 to ensure that the "werk" field has the correct data type. If the Parquet file schema is correct, you can update the AWS Glue Data Catalog table schema to match the schema of the Parquet file. You can do this using the AWS Glue console or the AWS Glue API. For more guidance, you can refer Creating tables, updating the schema, and adding new partitions in the Data Catalog from AWS Glue ETL jobs.
Relevant content
- asked 8 months ago
- asked 2 years ago
- asked 2 years ago
- AWS OFFICIALUpdated 9 months ago
- AWS OFFICIALUpdated a year ago
