aws-node Daemonset (AWS EKS v1.21) with strange readiness timeoutSeconds

0

We have here 2 EKS clusters and both sometimes appear in events, readiness Probe failure, from any aws-node Pod. Looking for the Daemonset manifest we have:

          livenessProbe:
            exec:
              command:
                - /app/grpc-health-probe
                - '-addr=:50051'
                - '-connect-timeout=2s'
                - '-rpc-timeout=2s'
            initialDelaySeconds: 60
            timeoutSeconds: 5
            periodSeconds: 10
            successThreshold: 1
            failureThreshold: 3
          readinessProbe:
            exec:
              command:
                - /app/grpc-health-probe
                - '-addr=:50051'
                - '-connect-timeout=2s'
                - '-rpc-timeout=2s'
            initialDelaySeconds: 1
            timeoutSeconds: 1
            periodSeconds: 10
            successThreshold: 1
            failureThreshold: 3

how can you see the livenessProbe exec command it has 2 timeouts, one for connection and the other for rpc, and the probe timeoutSeconds is 5 (easialy would be the amount value of exec commands plus 1 second).

Now looking for readinessProbe we have the same exec command from livenessProbe but the timeoutSeconds is only 1 second.

If you check in the EKS Services probably will not find a service linked with these Pods. So it does not affect any service.

Anyway are error messages that could be out from our logs, that don´t make sense, for now, to have.

I guess a simple fix in readiness timeoutSeconds to 5 (like liveness) in this Deamonset would be enough.

Did anyone have this problem or think of resolving it in this way?

  • One idea I guess is to set de timeoutSeconds of readinessProbe with the same value of livenessProbe (5) because both of them use the same command to check so the timeout should be the same in the first moment. My doubt is if change it, the eksctl utils update-aws-node --cluster=<clusterName> would brake.

profile picture
질문됨 2년 전135회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠