Transfer 10TB data from On prem oracle DB to S3 Galcier

Hi,

There is no limit to how much data you can store in your S3 bucket in “Glacier” Storage Class however, there are a few a limitations that you should consider,

a) Object stored in Glacier storage class are not directly accessible for download, they must be first restored to be accessible. When you restores an object, a temporary copy of the object is made available for access. You can refer to the below document for details on how a glacier object can be restore

Restoring an archived object: https://docs.aws.amazon.com/AmazonS3/latest/userguide/restoring-objects.html

b) You cannot use My SQL directly to make SQL queries against S3 object but you can make use of the S3 Select feature which allows you to use structured query language (SQL) statements to filter the contents of an Amazon S3 object and retrieve only the subset of data that you need. This is the only available method that allows you to use SQS query to filter data but it can only be done via authorised users who have the required IAM permissions. You can refer to the below document for details regarding the implementation and its limitations, ##Filtering and retrieving data using Amazon S3 Select: https://docs.aws.amazon.com/AmazonS3/latest/userguide/selecting-content-from-objects.html ##Examples of using Amazon S3 Select on objects: https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-select.html

I hope this information proves helpful to you.

Have a good day ahead!