AWS Glue Crawler - single record CSV

0

when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least 2 rows and I have some files that only have 1 row. How can I get classification to work well so I can generate the metadata correctly?Introduce la descripción de la imagen aquí Thanks for the support

  • I wouldn't worry too much about the classification, the important thing is that the table has the right serde and clients like Athena can read it correctly. To me it would make more sense that directory being a table sharing the same schema, having too many tables is a bad experience for users

profile picture
EXPERT
demandé il y a 7 mois111 vues
Aucune réponse

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions