Can't get FSx for Lustre client working on Rocky Linux 8.7

Question

Hello,

I'm trying to get the FSx for Lustre client working on Rocky Linux 8.7. I've read this page:

https://docs.aws.amazon.com/fsx/latest/LustreGuide/install-lustre-client.html

...where it also states that my kernel 4.18.0-425 should be compatible. So I followed the guide under the section:

**CentOS, Rocky Linux, and Red Hat / To install the Lustre client on CentOS and Red Hat 8.2 and newer or on Rocky Linux 8.4 and newer**

I can get through all the steps successfully, including actually installing the client, but when I try to mount the FSx volume via systemd like this

sudo systemctl enable mnt-fsx.mount
    sudo systemctl start mnt-fsx.mount

It results in a soft lockup:

Message from syslogd@flame01 at Jul 17 07:15:46 ... kernel:watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [pmdalinux:27713]

Then the instance becomes unresponsive... can't connect to it after a forced reboot.

My mount unit file looks like this:

#!/bin/bash

[Unit]
    Description=Mount FSx file system
    Requires=network-online.target
    After=network-online.target

[Mount]
    What=fs-xxxxxxxxxxxx.fsx..amazonaws.com:/mountname
    Where=/mnt/fsx
    Type=lustre
    Options=defaults,_netdev

[Install]
    WantedBy=multi-user.target

(Yep, confirmed that DNSName and LustreMountName are correct in the CloudFormation JSON before creating the stack.)

I can get this all working by following the similar steps for my Ubuntu instance, so I'm thinking it's something wrong I'm doing due to my unfamiliarity with Rocky. Appreciate any guidance here from the community!

Thanks very much,
Ean

rePost-User-ean · Accepted Answer

Ok, with AWS support's help, turns out I had to update the kernel then all good.

Didier_Durand · Answer

Hi,

A 'soft lockup' is defined as a bug that causes the kernel to loop in kernel mode for more than 20 seconds without giving other tasks a chance to run. The watchdog daemon will send an non-maskable interrupt (NMI) to all CPUs in the system who, in turn, print the stack traces of their currently running tasks.

Given the end of your error message: this problem seems to be reported for PMDA process. See https://manpages.ubuntu.com/manpages/focal/man1/pmdaproc.1.html

You may want to try to stop this process. But, no guarantee: PMDA may just be the detector of of the lockup not its cause...

You may also want to open an AWS Support ticket.

Best,

Didier

Steve_M · Answer

You're running Rocky Linux 8.7 - according to https://docs.aws.amazon.com/fsx/latest/LustreGuide/prerequisites.html FSx for Lustre is only supported up to 8.6 (whether it's RHEL, CentOS or Rocky):

>  CentOS and Red Hat Enterprise Linux 7.5 through 7.9 and 8.2 through 8.6, Rocky Linux 8.4 through 8.6

Could you try it with an older version of the AMI and see if it makes a difference?

Can't get FSx for Lustre client working on Rocky Linux 8.7

相關內容