2 Risposte
- Più recenti
- Maggior numero di voti
- Maggior numero di commenti
1
This is done by Hadoop if the folder does not exist. This _$folder$ is just a placeholder. This is created by mkdir commands. The actual folder is only created when first file is placed. The other jobs where this is not happening might be writing to existing folders. These files should not cause a problem.
con risposta un anno fa
0
This happens because of the S3 path you use during writing.
s3:// vs s3a://
s3:// will make the folder s3a:// will not
They both have their ups and downs and is generally recommended to stick with s3://.
con risposta un anno fa
Contenuto pertinente
- AWS UFFICIALEAggiornata 3 anni fa
- AWS UFFICIALEAggiornata 2 anni fa
- AWS UFFICIALEAggiornata 2 anni fa