1 Answer
- Newest
- Most votes
- Most comments
0
Hi @gbradford,
We allow SharedStorage options where the Storage is being accessed by HeadNode and compute Node.
You can use external ( exiting storage) or let ParallelCluster create Storage for you ( managed Storage).
From ParallelCluster 3.8.0 onwards we allow the usage of /home
as a mount point as well.
Please refer to Docs for More details https://docs.aws.amazon.com/parallelcluster/latest/ug/shared-storage-quotas-integration-v3.html
Thanks
answered 6 months ago
Relevant content
- Accepted Answerasked a year ago
- How do I install and troubleshoot Python libraries in Amazon EMR and Amazon EMR Serverless clusters?AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
Thanks for your answer. I found that the issue was really that the python version on the compute node didn't match the python version on the head node. (I had updated python to 3.8 on the head node) I found that adding sudo amazon-linux-extras enable python3.8 sudo yum install -y python38 to the beginning of my sbatch script solved the issue