Creating custom YAML files for AWS Parallel Cluster

Question

I am trying to follow the tutorial for running FDS/SMV on AWS Parallel Cluster here: https://aws.amazon.com/blogs/compute/fire-dynamics-simulation-cfd-workflow-using-aws-parallelcluster-elastic-fabric-adapter-amazon-fsx-for-lustre-and-nice-dcv/ .  I get to the point where it asks me to setup a config file with the following data:

```
[aws]
aws_region_name =

[global]
sanity_check = true
cluster_template = fds-smv-cluster
update_check = true

[vpc public]
vpc_id = vpc-
m ster_subnet_id = subnet-

[cluster fds-smv-cluster]
key_name = 
vpc_settings = public
compute_instance_type=c5n.18xlarge
m ster_instance_type=c5.xlarge
initial_queue_size = 0
max_queue_size = 100
scheduler=slurm
cluster_type = ondemand
s3_read_write_resource=arn:aws:s3:::fds-smv-bucket-unique*
placement_group = DYNAMIC
placement = compute
base_os = alinux2
tags = {"Name" : "fds-smv"}
disable_hyperthreading = true
fsx_settings = fsxshared
enable_efa = compute
dcv_settings = hpc-dcv

[dcv hpc-dcv]
enable = m ster

[fsx fsxshared]
shared_dir = /fsx
storage_capacity = 1200
import_path = s3://fds-smv-bucket-unique
imported_file_chunk_size = 1024
export_path = s3://fds-smv-bucket-unique

[aliases]
ssh = ssh {CFN_USER}@{M STER_IP} {ARGS}
```
I am unable to create a YAML file that will be accepted by Parallel Cluster to create-cluster.  It returns the error:

```
{
  "message": "Bad Request: Configuration must be a valid YAML document"
}

```

I attempted to create a YAML file using AWS Parallel Cluster configure wizard (https://docs.aws.amazon.com/parallelcluster/latest/ug/install-v3-configuring.html) but it does not have all the specifications, like a shared s3 bucket in Fsx, like the tutorial asks for.  I tried starting with the wizard created configuration file and editing it so it looks like the YAML files in documentation, but it still returns the same error.

See my edited YAML file here:

```
Region: us-east-2
Image:
  Os: alinux2
HeadNode:
  InstanceType: c5.xlarge
  Networking:
    SubnetId: subnet-032f3e6409362aff2
  Ssh:
    KeyName: MyKeyPair1
  DisableSimultaneousMultithreading: true
Scheduling:
  Scheduler: slurm
  SlurmQueues:
  - Name: queue1
    CapacityType: ONDEMAND
    ComputeResources:
    - Name: c5n18xlarge
      InstanceType: c5n.18xlarge
      MinCount: 0
      MaxCount: 100
	  Efa:
	    Enabled: true  
    Networking:
      SubnetIds:
      - subnet-032f3e6409362aff2
    Iam:
      S3Access:
        - BucketName: fds-smv-jts-bucket-1
          EnableWriteAccess: True
      AdditionalIamPolicies:
        - Policy: arn:aws:s3:::fds-smv-jts-bucket-1*
SharedStorage:
  - MountDir: /fsx
    StorageType: FsxLustre  
	FsxLustreSettings:
      StorageCapacity: 1200
      ImportedFileChunkSize: 1024
      ExportPath: s3://fds-smv-jts-bucket-1
      ImportPath: s3://fds-smv-jts-bucket-1
Tags:
  - Key: String
    Value: fds-smv
DevSettings
  ClusterTemplate: fds-smv-cluster
```

Any ideas on how to create the proper YAML file with all the data that is requested for the tutorial?

Thank you!

Accepted Answer

In your yaml, you're missing a semicolon after the DevSettings key. I use yamllint (https://pypi.org/project/yamllint/) to lint my yaml files, which may help when validating yaml.

In addition, PCluster 3 includes a configuration converter (https://docs.aws.amazon.com/parallelcluster/latest/ug/pcluster3-config-converter.html). I'd suggest you try to execute that against your pre 3.x configuration file.

You can also find the Parallel Cluster 3 configuration file format here: https://docs.aws.amazon.com/parallelcluster/latest/ug/cluster-configuration-file-v3.html. I think you're looking for the import path and export path associated with an FSX system, which is here (https://docs.aws.amazon.com/parallelcluster/latest/ug/SharedStorage-v3.html#yaml-SharedStorage-FsxLustreSettings-ImportPath) in 3.x configs.

Creating custom YAML files for AWS Parallel Cluster

My first few lines look like this: '

Relevant content