AWS Glue - Data Catalog Read Extra Column

I'm running into an issue when reading a Glue Data Catalog data source in an Visual ETL AWS Glue job. An extra column is being added in called 'col40', which is not in the underlying file that was crawled. When I look at the Data Catalog table schema, I'm not seeing this extra column. Any idea what could be causing this unexpected behavior to occur?

主题

存储分析

标签

亚马逊简单存储服务 (S3)AWS Glue

语言

English

Matt

已提问 2 个月前201 查看次数

1 回答

最新
投票最多
评论最多

这些答案有用吗？为正确答案投票，以帮助社区从您的知识中受益。

The generated code uses DynamicFrame to infer the schema dynamically. You must be using CSV files and one or more of the rows have an extra field (or the separator escaping is not working correctly)

专家

Gonzalo Herreros

已回答 2 个月前

AWS Glue - Data Catalog Read Extra Column

相关内容