DataSync Trouble : S3 to FSx Lustre. Skipped S3 prefix not supported by DataSync

Greetings, The presence of a directory with a forward slash (/) in the S3 bucket may be causing issues with the DataSync task. One possible solution could be to modify the prefix used in the DataSync task to exclude the root directory of the S3 bucket.

For example, if the S3 bucket has a directory structure like this: s3://example-bucket/ |- / |- directory-1/ |- directory-2/ ... You could try modifying the prefix used in the DataSync task to something like s3://example-bucket/directory-1/, which would exclude the root directory (/) and only include the contents of directory-1.

Alternatively, if it's not possible to modify the prefix used in the DataSync task, you could try moving the contents of the root directory (/) to a subdirectory, and then excluding the root directory from the DataSync task. For example: s3://example-bucket/ |- root/ |- <contents of root directory> |- directory-1/ |- directory-2/ ... In this case, you could modify the prefix used in the DataSync task to s3://example-bucket/directory-1/, and exclude the root directory.

I hope this helps! Let me know if it was helpful

Hi,

After some investigations, the trouble comes from your bucket (several) have a directory (/). In this case, DataSync have some troubles to check the integrity.

Regards, Vivien Moretto