By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

AWS Glue Crawler - single record CSV

0

when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least 2 rows and I have some files that only have 1 row. How can I get classification to work well so I can generate the metadata correctly?Introduce la descripción de la imagen aquí Thanks for the support

  • Gonzalo Herreros EXPERT
    6 months ago

    I wouldn't worry too much about the classification, the important thing is that the table has the right serde and clients like Athena can read it correctly. To me it would make more sense that directory being a table sharing the same schema, having too many tables is a bad experience for users

Topics
Analytics
Tags
AnalyticsAWS Glue
Language
English
profile picture
EXPERT
MaxCloud
asked 6 months ago109 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content