Can AWS ParallelCluster support 3rd party storage instead of using FSxL, EFS, or S3?

0

Hello, I understand ParallelCluster supports FSxL/FSxZ for high performance use cases. I have a client that is interested in using a 3rd party storage solution via AWS Marketplace because they are already a customer and would like to consolidate their storage into smaller platform/services.

thanks, Eric

AWS
asked a month ago38 views
1 Answer
0

AWS ParallelCluster primarily supports AWS-native storage solutions like Amazon EBS, Amazon EFS, FSx for Lustre, FSx for ONTAP, and FSx for OpenZFS. While these are the officially supported and integrated options, AWS ParallelCluster does not have built-in support for third-party storage solutions from the AWS Marketplace.

However, this doesn't necessarily mean it's impossible to use a third-party storage solution with AWS ParallelCluster. Depending on the specific third-party storage solution and how it can be integrated with EC2 instances, it might be possible to configure it manually within the cluster. This would likely require custom scripts or configurations outside of ParallelCluster's native management.

It's important to note that using a non-supported storage solution would mean losing some of the automated management and integration features that ParallelCluster provides for supported storage options. This could include aspects like automatic mounting, performance optimization, and lifecycle management.

If your client is set on using their preferred third-party storage solution, they might need to work with both AWS support and the third-party vendor to determine the best way to integrate it with ParallelCluster. This could involve custom configurations or even modifications to the ParallelCluster setup.

Given the complexity and potential loss of native integration, it would be advisable to carefully consider the trade-offs between using a supported AWS storage solution versus a third-party option. The client should evaluate factors such as performance requirements, ease of management, cost, and existing familiarity with the third-party solution.
Sources
Shared storage - AWS ParallelCluster
AWS services used by AWS ParallelCluster - AWS ParallelCluster

profile picture
answered a month ago
AWS
EXPERT
reviewed a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions