Able to check the container details of running emr pod

2

I would like to know the way/step to inspect the running driver/executor pods in emr on eks cluster. Do not find any steps specific to this use case. Please help me out. Thanks in advance.

Mark
asked 7 months ago260 views
1 Answer
3
Accepted Answer

Hello,

If you are running pods in EMR on EKS, there are a couple of ways you can inspect the containers. Direct method, you can check,

kubectl describe pod <pod-name> -n <name-space>

To check the logs of specific container that referred from above command,

kubectl logs pod <pod-name> -n <name-space> -c <container-name> -f

On the other hand, if you would like to check the resources and inspect containers in more details, you can login into the k8s cluster node and run the docker commands, Make sure you have ssh key configured in the eks cluster,

Generate the key for the later use,

ssh-keygen

Create the eks cluster with self-managed nodes,

eksctl create cluster --name $clusterName \
--nodegroup-name group-m5-large \
--node-type m5.large
--nodes-min 2 \
--nodes-max 4 \
--ssh-access --ssh-public-key /home/ec2-user/.ssh/id_rsa.pub.

SSh into the cluster's node and perform the below commands,

To check the list of running containers,

docker ps

To get details for the container

docker inspect 27787df99aea7

To login the container

docker exec -it 27787df99aea7 /bin/bash

To check the running processes inside the container,

bash-4.2$ ps -auxwww

AWS
SUPPORT ENGINEER
answered 7 months ago
profile picture
EXPERT
reviewed 6 months ago
  • Thanks, this is helpful

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions