By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

EMR cluster gets terminated with error

0

Hello, AWS support community, I have an issue with creating an EMR cluster. Every time I implement the launch, the cluster gets terminated with the error message "terminated with error" I don't know why this happens. Could you help me to solve this issue? Thank you.

Topics
AnalyticsCompute
Tags
AnalyticsAmazon EC2Amazon EMR
Language
English
rePost-User-2201973
asked a year ago696 views
2 Answers
0

Hello,

Thank you for raising your question in re:Post.

Based on what I can gather from your question, your attempts to create EMR Cluster fails with an error with no clear message on why or what the root cause is.

Cluster creation constitutes multiple steps, starting from requesting EC2 instances, installing the required services that coordinates the nodes in the cluster, installing bootstrap if you had any and at the very end installing the application you had selected.

Since there are no indicator from your question at what step this is failing, I would suggest you raise a case with AWS Support and our support engineers can take a look at your cluster and advise you on what would help.

While creation of the cluster you would have selected S3 path for cluster logs, if you did, do you see any logs in those directory? If not that would mean it is failing much earlier stage and could be related to the configuration you had selected eg: Custom AMI

If you do have logs in that location, have a look at the log files puppet.log.gz or stderr.log.gz in the location s3://<full-path-to-cluster-logs>/node/<Primary node instanceId>/provision-node/apps-phase/0/*/. If you have not worked with puppet logs before it may not be straightforward to find the error there and hence I would recommend you raise a case with us.

Hope this helps.

AWS
SUPPORT ENGINEER
Krishnadas M
answered a year ago
  • rePost-User-2201973
    a year ago

    Hello Krishnadas,

    Thanks for your response. Here are the steps that I took to take.

    1. Enter EMR service
    2. Click "Create Cluster"
    3. Gave a "Name", and chose "Core Hadoop", took the other setting as is
    4. Select "size 2" at Cluster scaling and provisioning
    5. Chose "Manually terminate cluster" and "Use termination protection"
    6. Specified Amazon S3 location from the existing S3 log folder's directory at Cluster logs
    7. At Tags, gave "Key: name", "Value: my cloud cluster"
    8. Created EC2 key pair for SSH at Security configuration and EC2 key pair
    9. Initially, I couldn't see "EMR_DefaultRole" and "EMR_EC2_DefaultRole" at Identity and Access Management (IAM roles), so I gave a command that I found in AWS's documentation to the shell command, then those two options popped up
    10. Create cluster
    11. Get the

    Please let me know if you see any skeptical steps that potentially cause the error. Thanks

  • rePost-User-2201973
    a year ago

    Also, since my AWS plan is Basic, I don't have a clue to raise the case for support.

0

Hello,

Thank you for replying. Basic plan does not include premium support so you will not be able to raise a case with AWS Support. re:Post is public and hence we cannot discuss anything specific to a customers account here.

From the steps alone it is not clear what could cause the issue. Please navigate to the EMR console and locate the failed EMR cluster and click on it to look into the details. Once you are in Cluster details page do you see any additional error message when you click on the "Terminated with errors" status message? If yes, that should give us a hint of possible causes but please understand that it alone may not be enough to get to the root cause of the issue you are facing.

Also, do you see logs in the S3 path you configured for Cluster logs?

AWS
SUPPORT ENGINEER
Krishnadas M
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content