By using AWS re:Post, you agree to the Terms of Use

Glue crawler ignores Int/Long with trailing whitespaces

0

We have incoming file with the fixed length field length (.dat). For example: |2|123 |AWS |0505 |3 When Glue Crawler crawles the file, it ignores all the int/long values that have trailing spaces. In this case 123 value won't appear in the result when querying created table in athena. I have tried to create the custom classifier to remove the white spaces however there is no specific custom Quote symbol that I can provide in the config to make crawler pick it up instead of default csv one. Any help would be appreciated

No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions