AWS Glue Crawler: Got an error Internal Service Exception

0

Hi, I have used Firehose, AWS Glue Crawler, and Athena since 2022, and everything as well until May 2023, when the AWS Glue Crawler got an Internal Service Exception. I can't find the exact reason. I also checked the Data Catalog -> Databases -> Schema and realized it created a partition hour only instead of partitions year, month, and day.

Can you guys help me predict my trouble? Thank you in advance.

Enter image description here

Tham
已提问 1 年前2089 查看次数
1 回答
3

You get Internal Service Exception on AWS Glue Crawler due to various reasons such as inconsistent data structure from upstreams, or if your data catalog has larger number of columns or nested structure that might exceeded the schema size limit. You can first check your crawler logs to see the possible errors. You can also refer https://repost.aws/knowledge-center/glue-crawler-internal-service-exception for further possible conditions that might triggered the exception. If the mentioned reasons don't apply to you it is better to open support case.

profile pictureAWS
BezuW
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则