ERROR while fitting RCF data : An error occurred (EntityTooLarge) when calling the PutObject operation: Your proposed upload exceeds the maximum allowed size.

0

I am fitting a RCF model to a dataset using rcf.fit(rcf.record_set(data[['Variable 1','Variable 2']].values.reshape(-1, 1))), but getting the below error :

An error occurred (EntityTooLarge) when calling the PutObject operation: Your proposed upload exceeds the maximum allowed size.

The size of the ndarray is 239393964

How can I fix this?

1 Answer
0

This error occurs when the object being uploaded to S3 is too large. If a single PUT operation is being used by the AWS SDKs, REST API, or AWS CLI, you can upload a single object up to 5 GB in size.

Uploading objects - https://docs.aws.amazon.com/AmazonS3/latest/userguide/upload-objects.html

To upload objects larger than 5 GB in size, you can use multipart upload, with multipart upload you can upload a single large object up to 5 TB in size.

Uploading and copying objects using multipart upload - https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html

AWS
Chris_T
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content