Skip to content

AWS glue header doesn't work properly

0

Hello. I am using aws glue, but the aws glue header does not automatically recognize it. In other words, the header is included in the data and the query does not work properly. The header is Korean, and I tried classfier, but it didn't work. Is there a solution?

plus. I use Athena to get the result.

asked 4 years ago1.8K views

2 Answers
0

The classifier has an option to enter the column names if your columns are not dynamic. Enter image description here Enter image description here

If that would not work, you could try one of the following:

  • Change the column names in the Data Catalog, set the SchemaChangePolicy to LOG, and set the partition output configuration to InheritFromTable for future crawler runs.
    
  • Create a custom grok classifier to parse the data and assign the columns that you want.
    
AWS

answered 4 years ago

0

Hi community,   I have tried crawling a csv source, without mentioning custom classifer of 'detect headings' by default in custom. hence it was not showing proper coloumn names in the catalog.  I tried editing the existing crawler with  that custom classifier, the table refelcted was still not fixed.   so i created new crawler with that custom classfier with 'detect heading', and it worked out, i am getting proper coloumn names in table. Thankyou

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.