Will s3 uri remain same when data is moved between storage layers for a spark workload?
0
My customer planning to use s3 for datalake and use spark to process the data. They want to use IA to move the data to glacier. When spark queries using s3 uri they want more insight into will they be able to access the data when moved to s3 glacier from spark workload and what will be the performance impact in accessing the same data.
gefragt vor 4 Jahren247 Aufrufe
1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
S3 object's URI does not change when it gets moved between storage classes. As the object moves from Standard to other storage classes, the access latency will increase (milliseconds for Standard, Standard-IA, One-Zone IA and Intelligence Tiering, select minutes/hours for Glacier and select hours for Glacier Deep Archive). [1]
Relevanter Inhalt
AWS OFFICIALAktualisiert vor 3 Jahren- AWS OFFICIALAktualisiert vor 2 Jahren