Will s3 uri remain same when data is moved between storage layers for a spark workload?
0
My customer planning to use s3 for datalake and use spark to process the data. They want to use IA to move the data to glacier. When spark queries using s3 uri they want more insight into will they be able to access the data when moved to s3 glacier from spark workload and what will be the performance impact in accessing the same data.
posta 4 anni fa247 visualizzazioni
1 Risposta
- Più recenti
- Maggior numero di voti
- Maggior numero di commenti
0
S3 object's URI does not change when it gets moved between storage classes. As the object moves from Standard to other storage classes, the access latency will increase (milliseconds for Standard, Standard-IA, One-Zone IA and Intelligence Tiering, select minutes/hours for Glacier and select hours for Glacier Deep Archive). [1]
Contenuto pertinente
AWS UFFICIALEAggiornata 4 mesi fa- AWS UFFICIALEAggiornata 2 anni fa
- AWS UFFICIALEAggiornata 3 anni fa