move files from s3 to s3 folder

0

i have s3 name test that have 100m files of jsons. i need to move 10m files to a new folder for that it can spread like this folder1 =10m folder2 =10m folder3 =10m folder4 =10m etc....

omern
gefragt vor 9 Monaten987 Aufrufe
1 Antwort
2

Hi,

most efficient way is to use the mv of S3 CLI: https://docs.aws.amazon.com/cli/latest/reference/s3/mv.html to rename your files via move (nothing will move indeed: it will just be a rename.)

You can use --include and --exclude to define your set of files to move to a given folder.

Second, run those commands from AWS cloudshell to run 100% on cloud with minimal latency: https://aws.amazon.com/cloudshell/

Best,

Didier

profile pictureAWS
EXPERTE
beantwortet vor 9 Monaten
  • i will be more clear: i have a main bucket that have 100M event

    i want to move all the file to folders of 10m

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen