Will s3 uri remain same when data is moved between storage layers for a spark workload?

Question

My customer planning to use s3 for datalake and use spark to process the data. They want to use IA to move the data to glacier. When spark queries using s3 uri they want more insight into will they be able to access the data when moved to s3 glacier from spark workload and what will be the performance impact in accessing the same data.

Accepted Answer

S3 object's URI does not change when it gets moved between storage classes. As the object moves from Standard to other storage classes, the access latency will increase (milliseconds for Standard, Standard-IA, One-Zone IA and Intelligence Tiering, select minutes/hours for Glacier and select hours for Glacier Deep Archive). [1]

[1] - https://aws.amazon.com/s3/storage-classes/

Will s3 uri remain same when data is moved between storage layers for a spark workload?

Relevant content