How to escape a comma in a csv file in AWS Glue?

0

Customer is using Glue to parse a CSV file.

The issue happens when trying to load a CSV file and one of its text column EQUIPMENT_DESCRIPTION has “,” (Comma) value in it. This column value is identified with text qualifier (double quotes). But the way we currently have our crawler/glue configured, we are not able to parse the column with the text qualifier to ignore comma values in it.

This is causing all the other columns following EQUIPMENT_DESCRIPTION, to be filled with incorrect data including the DATE_COLLECTED column.

How do you configure Glue to ignore this comma?

AWS
MODERATOR
gefragt vor 5 Jahren2976 Aufrufe
1 Antwort
0
Akzeptierte Antwort

You should confirm that the quote character is configured appropriately in the SerDe properties of the table?

Have a look at Working with CSV Files in Best Practices When Using Athena With AWS Glue.

AWS
EXPERTE
JDB
beantwortet vor 5 Jahren
profile picture
EXPERTE
überprüft vor einem Monat

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen