AWS Glue Crawler: Got an error Internal Service Exception

0

Hi, I have used Firehose, AWS Glue Crawler, and Athena since 2022, and everything as well until May 2023, when the AWS Glue Crawler got an Internal Service Exception. I can't find the exact reason. I also checked the Data Catalog -> Databases -> Schema and realized it created a partition hour only instead of partitions year, month, and day.

Can you guys help me predict my trouble? Thank you in advance.

Enter image description here

Tham
demandé il y a un an2122 vues
1 réponse
3

You get Internal Service Exception on AWS Glue Crawler due to various reasons such as inconsistent data structure from upstreams, or if your data catalog has larger number of columns or nested structure that might exceeded the schema size limit. You can first check your crawler logs to see the possible errors. You can also refer https://repost.aws/knowledge-center/glue-crawler-internal-service-exception for further possible conditions that might triggered the exception. If the mentioned reasons don't apply to you it is better to open support case.

profile pictureAWS
BezuW
répondu il y a un an

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions