How to connect an existing dynamo table to an EMR cluster?

Question

based on the documentation here , https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/EMRforDynamoDB.Querying.html, data can be copied from an  EMR cluster to dynamo db and we run Hive queries in dynamo db. is it possible to run Hive queries directly in dynamo db? if yes, will this work after copying the data from EMR cluster to dynamo, we terminate the the EMR cluster?

Answer

Hi CloudUser,

Your question is not clear. Do you want to delete the EMR cluster after copying data from it to DynamoDB, then continue to use DynamoDB? Yes, you can do that. However, if you want to continue to use Hive queries you might consider keeping your EMR cluster or have a self-managed Apache HBase on Amazon EC2 setup for that ([AWS Doc]( https://docs.aws.amazon.com/whitepapers/latest/comparing-dynamodb-and-hbase-for-nosql/self-managed-apache-hbase-deployment-model-on-amazon-ec2.html )). Alternately, you can use [PartiQL](https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ql-reference.html) to query data from your DyanamoDB. To connect your existing DynamoDB table with EMR please follow the instructions on this [documentation](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/EMR_Hive_Commands.html).

How to connect an existing dynamo table to an EMR cluster?

관련 콘텐츠