I managed to use glue crawler to crawled data (parquet file) from s3, however the column with type "boolean" is recognised as "string" when checking the data schema. Although i can edit the schema on the metadata catalogue, this is breaking the query on Athena as the data type is not recognised as boolean. Is there anyway to configure the serde parameter for glue crawler to automatically recognise this?
Additional information:
- I have created the table using python pandas. Had workaround converting boolean to string given "True/False" is not recognised by glue/Athena.
- Tried create table using Athena to ingest from s3. However, no data was shown when querying,
- Tried visual ETL. Can't transform string to boolean.
Any suggestion would be appreciated.
AWS 官方已更新 3 年前