move files from s3 to s3 folder

0

i have s3 name test that have 100m files of jsons. i need to move 10m files to a new folder for that it can spread like this folder1 =10m folder2 =10m folder3 =10m folder4 =10m etc....

omern
已提问 9 个月前989 查看次数
1 回答
2

Hi,

most efficient way is to use the mv of S3 CLI: https://docs.aws.amazon.com/cli/latest/reference/s3/mv.html to rename your files via move (nothing will move indeed: it will just be a rename.)

You can use --include and --exclude to define your set of files to move to a given folder.

Second, run those commands from AWS cloudshell to run 100% on cloud with minimal latency: https://aws.amazon.com/cloudshell/

Best,

Didier

profile pictureAWS
专家
已回答 9 个月前
  • i will be more clear: i have a main bucket that have 100M event

    i want to move all the file to folders of 10m

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则