AWS Glue Crawler: Got an error Internal Service Exception

0

Hi, I have used Firehose, AWS Glue Crawler, and Athena since 2022, and everything as well until May 2023, when the AWS Glue Crawler got an Internal Service Exception. I can't find the exact reason. I also checked the Data Catalog -> Databases -> Schema and realized it created a partition hour only instead of partitions year, month, and day.

Can you guys help me predict my trouble? Thank you in advance.

Enter image description here

Tham
posta un anno fa2121 visualizzazioni
1 Risposta
3

You get Internal Service Exception on AWS Glue Crawler due to various reasons such as inconsistent data structure from upstreams, or if your data catalog has larger number of columns or nested structure that might exceeded the schema size limit. You can first check your crawler logs to see the possible errors. You can also refer https://repost.aws/knowledge-center/glue-crawler-internal-service-exception for further possible conditions that might triggered the exception. If the mentioned reasons don't apply to you it is better to open support case.

profile pictureAWS
BezuW
con risposta un anno fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande