move files from s3 to s3 folder

0

i have s3 name test that have 100m files of jsons. i need to move 10m files to a new folder for that it can spread like this folder1 =10m folder2 =10m folder3 =10m folder4 =10m etc....

omern
已提問 9 個月前檢視次數 987 次
1 個回答
2

Hi,

most efficient way is to use the mv of S3 CLI: https://docs.aws.amazon.com/cli/latest/reference/s3/mv.html to rename your files via move (nothing will move indeed: it will just be a rename.)

You can use --include and --exclude to define your set of files to move to a given folder.

Second, run those commands from AWS cloudshell to run 100% on cloud with minimal latency: https://aws.amazon.com/cloudshell/

Best,

Didier

profile pictureAWS
專家
已回答 9 個月前
  • i will be more clear: i have a main bucket that have 100M event

    i want to move all the file to folders of 10m

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南