Read Delta Lakes with Presto 0.272 (EMR 6.7.0)

Question

EMR 6.7.0 has updated Presto to 0.272, which includes the new [Delta Lake connector](https://docs.delta.io/latest/presto-integration.html) (added on 0.269). However, a new property file needs to be added to the instance (`delta.properties`) to configure such connector. By checking the list of classifications for this latest version of EMR, I was not able to find a configuration for this new connector. This is the list of classifications for presto connectors:

- presto-connector-blackhole
- presto-connector-cassandra
- presto-connector-hive
- presto-connector-jmx
- presto-connector-kafka
- presto-connector-localfile
- presto-connector-memory
- presto-connector-mongodb
- presto-connector-mysql
- presto-connector-postgresql
- presto-connector-raptor
- presto-connector-redis
- presto-connector-redshift
- presto-connector-tpch
- presto-connector-tpcds

I would expect a new classification like `presto-connector-delta` that allows us to create the `delta.properties` files as specified in the [presto documentation](https://prestodb.io/docs/current/connector/deltalake.html).

Is there anything I am missing, or is this missing on EMR?

Thank you in advance.

Answer

Hi @Sujay_M,

Will the "presto-connector-delta" and "trino-connector-delta" be added for next release? If so, when will the next release come out?

For anyone having this problem, fortunately, there is a workaround which is to use any other connector (e.g. presto-connector-localfile), and specify the "connector.name=delta", instead of the default one which would be the name of that configuration (e.g. localfile). Then, the connector will be the delta one, but the name of the catalog will be "localfile".

Regards,

Answer

Hi,

thank you for writing to re:Post.

Currently this classification is not available on EMR

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-670-release.html

Read Delta Lakes with Presto 0.272 (EMR 6.7.0)

相关内容