AWS Glue Crawler: Got an error Internal Service Exception

0

Hi, I have used Firehose, AWS Glue Crawler, and Athena since 2022, and everything as well until May 2023, when the AWS Glue Crawler got an Internal Service Exception. I can't find the exact reason. I also checked the Data Catalog -> Databases -> Schema and realized it created a partition hour only instead of partitions year, month, and day.

Can you guys help me predict my trouble? Thank you in advance.

Enter image description here

Tham
已提問 1 年前檢視次數 2100 次
1 個回答
3

You get Internal Service Exception on AWS Glue Crawler due to various reasons such as inconsistent data structure from upstreams, or if your data catalog has larger number of columns or nested structure that might exceeded the schema size limit. You can first check your crawler logs to see the possible errors. You can also refer https://repost.aws/knowledge-center/glue-crawler-internal-service-exception for further possible conditions that might triggered the exception. If the mentioned reasons don't apply to you it is better to open support case.

profile pictureAWS
BezuW
已回答 1 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南