AWS Glue read a csv file encoded in Windows 1252 with extended characters
0
Is there an option to enable the Dyanmicframe Reader to open a file encoded in cp1252 charset (Windows latin with extended characterset) ?
1 Answer
- Newest
- Most votes
- Most comments
0
Currently, you would need to read the file using the spark.read and than convert to DynamicFrame, see an example below:
df_1252_all = spark.read.option("header", "true").option("charset", "cp1252").csv("s3a://My-BUCKET/cp1252_all.csv") dyn_all= DynamicFrame.fromDF(df_1252_all, glueContext, "dyn_all")
Relevant content
- asked 2 years ago
- Accepted Answer
asked 4 years ago - asked 2 years ago
AWS OFFICIALUpdated a year ago- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
