How to escape a comma in a csv file in AWS Glue?
Customer is using Glue to parse a CSV file.
The issue happens when trying to load a CSV file and one of its text column EQUIPMENT_DESCRIPTION has “,” (Comma) value in it. This column value is identified with text qualifier (double quotes). But the way we currently have our crawler/glue configured, we are not able to parse the column with the text qualifier to ignore comma values in it.
This is causing all the other columns following EQUIPMENT_DESCRIPTION, to be filled with incorrect data including the DATE_COLLECTED column.
How do you configure Glue to ignore this comma?
AWS glue combining multiple input into a single output csvasked 3 months ago
AWS Glue crawler detecting a .(dot) before header of a csv fileasked 3 years ago
escape caracter in AWS glueAccepted Answerasked 4 months ago
AWS Glue read a csv file encoded in Windows 1252 with extended charactersAccepted AnswerEXPERTasked 6 months ago
How could we have Glue to get data from csv as String?Accepted Answerasked 7 days ago
Glue processing a csvAccepted Answerasked 2 years ago
How to escape a comma in a csv file in AWS Glue?Accepted AnswerMODERATORasked 3 years ago
Amazon Athena query outputting all columns in the csv as VARCHARsAccepted Answerasked 2 years ago
Error reading Kinesis table in Zeppelinasked 3 months ago
How do I get the output of an AWS Glue DataBrew job to be a single CSV file?Accepted Answerasked a year ago