AWS Glue Crawler - single record CSV
0
when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least 2 rows and I have some files that only have 1 row. How can I get classification to work well so I can generate the metadata correctly?
Keine Antworten
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
Relevanter Inhalt
AWS OFFICIALAktualisiert vor 2 Jahren- AWS OFFICIALAktualisiert vor 3 Jahren
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
I wouldn't worry too much about the classification, the important thing is that the table has the right serde and clients like Athena can read it correctly. To me it would make more sense that directory being a table sharing the same schema, having too many tables is a bad experience for users