Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Read Delta Lakes with Presto 0.272 (EMR 6.7.0)

0

EMR 6.7.0 has updated Presto to 0.272, which includes the new Delta Lake connector (added on 0.269). However, a new property file needs to be added to the instance (delta.properties) to configure such connector. By checking the list of classifications for this latest version of EMR, I was not able to find a configuration for this new connector. This is the list of classifications for presto connectors:

  • presto-connector-blackhole
  • presto-connector-cassandra
  • presto-connector-hive
  • presto-connector-jmx
  • presto-connector-kafka
  • presto-connector-localfile
  • presto-connector-memory
  • presto-connector-mongodb
  • presto-connector-mysql
  • presto-connector-postgresql
  • presto-connector-raptor
  • presto-connector-redis
  • presto-connector-redshift
  • presto-connector-tpch
  • presto-connector-tpcds

I would expect a new classification like presto-connector-delta that allows us to create the delta.properties files as specified in the presto documentation.

Is there anything I am missing, or is this missing on EMR?

Thank you in advance.

Topics
Analytics
Tags
Amazon EMR
Language
English
asked 3 years ago505 views
3 Answers
1

You can using post bootrap action script to configure additional catalog in presto like delta or change the hive catalog settings. You can refer this document for more details.

AWS
SUPPORT ENGINEER
answered 2 years ago
0

Hi,

thank you for writing to re:Post.

Currently this classification is not available on EMR

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-670-release.html

AWS
answered 3 years ago
AWS
SUPPORT ENGINEER
reviewed 2 years ago
0

Hi @Sujay_M,

Will the "presto-connector-delta" and "trino-connector-delta" be added for next release? If so, when will the next release come out?

For anyone having this problem, fortunately, there is a workaround which is to use any other connector (e.g. presto-connector-localfile), and specify the "connector.name=delta", instead of the default one which would be the name of that configuration (e.g. localfile). Then, the connector will be the delta one, but the name of the catalog will be "localfile".

Regards,

answered 3 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content