在从Glue数据库导入S3数据到QuickSight时,出现“HIVE_PARTITION_SCHEMA_MISMATCH”错误。

0

【以下的问题经过翻译处理】 在从Glue数据库导入S3数据到QuickSight时,出现“HIVE_PARTITION_SCHEMA_MISMATCH”错误。错误内容如下: HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'attributes' in table 'clickstream-ctr-database.care_events_dev1' is declared as type 'structaid:string,kvstriggerlambdaresult:string,sak:string,savecallrecording:string,sst:string,startstreamingaudiostatus:string,transcribecall:string,getlang:string,getaeroplanno:string,getemergency:string,getholiday:string,getlanguage:string,getlanguageselected:string,getpin:string,getpriority:string,language:string,userlanguage:string', but partition 'partition_0=ctr/partition_1=2022/partition_2=04/partition_3=04/partition_4=12' declared column 'attributes' as type 'structgetaeroplanno:string,getemergency:string,getholiday:string,getlanguage:string,getlanguageselected:string,getpin:string,getpriority:string'.

profile picture
전문가
질문됨 5달 전27회 조회
1개 답변
0

【以下的回答经过翻译处理】 日志所提到的问题是,虽然网页爬虫在表中发现了一个包含某个嵌套值数量的架构,该值位于 struct 字段中,但至少一个分区在相同的 struct 内具有不同的值集合。

为了避免这种情况,你可以尝试删除表并重新运行网页爬虫,修改它以防止模式变化,如此处所述,具体来说,你可以尝试配置它以“更新所有新的和现有分区中的元数据” 。

此外,QuickSight不支持 struct 数据类型,因此您需要在控制台或通过API将数据类型修改为字符串。

profile picture
전문가
답변함 5달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠