2 Respostas
- Mais recentes
- Mais votos
- Mais comentários
1
This is done by Hadoop if the folder does not exist. This _$folder$ is just a placeholder. This is created by mkdir commands. The actual folder is only created when first file is placed. The other jobs where this is not happening might be writing to existing folders. These files should not cause a problem.
respondido há um ano
0
This happens because of the S3 path you use during writing.
s3:// vs s3a://
s3:// will make the folder s3a:// will not
They both have their ups and downs and is generally recommended to stick with s3://.
respondido há um ano
Conteúdo relevante
- AWS OFICIALAtualizada há 2 anos
- AWS OFICIALAtualizada há 2 anos
- AWS OFICIALAtualizada há 2 anos