Will s3 uri remain same when data is moved between storage layers for a spark workload?
0
My customer planning to use s3 for datalake and use spark to process the data. They want to use IA to move the data to glacier. When spark queries using s3 uri they want more insight into will they be able to access the data when moved to s3 glacier from spark workload and what will be the performance impact in accessing the same data.
feita há 4 anos247 visualizações
1 Resposta
- Mais recentes
- Mais votos
- Mais comentários
0
S3 object's URI does not change when it gets moved between storage classes. As the object moves from Standard to other storage classes, the access latency will increase (milliseconds for Standard, Standard-IA, One-Zone IA and Intelligence Tiering, select minutes/hours for Glacier and select hours for Glacier Deep Archive). [1]
Conteúdo relevante
AWS OFICIALAtualizada há 3 meses- AWS OFICIALAtualizada há 2 anos