Crawler pulled Snowflake table, but Athena failed to query it.

Question

Using Glue we can crawl snowflake table properly in catalog but Athena failed to query table data:
HIVE_UNSUPPORTED_FORMAT: Unable to create input format

Googling results suggested it's because of table created by crawler has empty "input format", "Output format"... yes they are empty for this table crawled from Snowflake. So the question is
1 why didn't crawler set them? (crawler can classify the table is snowflake correctly)
2 what the values should be if manual edit is needed?

Is Snowflake table able to be queried by Athena?

Any idea? Thanks,

rePost-User-0607628 · Answer

Hi,

You can query Snowflake using Athena via the Federated query feature of Athena. Crawling the Snowflake tables will add them to your data catalog, but you can't point Athena directly to these tables and query them. I will drop the blog on how to set up the Athena connector for Snowflake, and also a blog on crawling your Snowflake tables and the use cases for that.

1. [Athena Federated query to Snowflake](https://aws.amazon.com/blogs/big-data/query-snowflake-using-athena-federated-query-and-join-with-data-in-your-amazon-s3-data-lake/)
2. [Crawling Snowflake tables with AWS Glue](https://aws.amazon.com/blogs/big-data/announcing-aws-glue-crawler-support-for-snowflake/)

Crawler pulled Snowflake table, but Athena failed to query it.

Añade tu respuesta

Contenido relevante