Custom Glue classifier

0

From time to time I have a csv file coming with single row and it breaks the Glue Crawler because of the at least 2 row requirement to be classified as a CSV. Is there a way I can provide a custom CSV classifier so I don't need to write a grok for 300+ columns? I can't seem to be able to figure out what to use in Quote symbol since I don't have any quotes in the csv. This is a snippet of the data: SSR|CCE|34|BBB||1 I can write something like this

(?<col0>^.*)(?:[^|]*\|)

as a grok and repeat 300 times but would be good to make it less ugly

Denys
asked 2 years ago156 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions