AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.
Glue Crawler and Classifiers - Supported file encodings: is UTF16 supported?
Hi, AWS Glue Crawlers with CSV and XML Classifiers and works well with files encoded in UTF-8 but not with file encoded in UTF-16.
Public documentation does not clarify this point:
- Do Glue crawler and classifier support UTF-16?
- Is there please an available documentation on supported encodings with Glue crawlers and classifiers?
Best regards,
Nicolas.
- Language
- English
asked 6 years ago1.4K views
- Newest
- Most votes
- Most comments
Glue at the moment supports UTF-8 encoded files only [1]. If UTF-16 files are passed in, you may encounter the "Internal Service Exception" error message. The most feasible method would be to programatically convert the utf-16 files to utf-8 before passing it through Glue Crawler.
[1] - https://docs.aws.amazon.com/glue/latest/dg/components-key-concepts.html
Relevant content
asked 9 months ago
asked 4 years ago
asked 6 years ago
- AWS OFFICIALUpdated 5 years ago
- AWS OFFICIALUpdated 8 months ago
