move files from s3 to s3 folder

0

i have s3 name test that have 100m files of jsons. i need to move 10m files to a new folder for that it can spread like this folder1 =10m folder2 =10m folder3 =10m folder4 =10m etc....

omern
질문됨 9달 전987회 조회
1개 답변
2

Hi,

most efficient way is to use the mv of S3 CLI: https://docs.aws.amazon.com/cli/latest/reference/s3/mv.html to rename your files via move (nothing will move indeed: it will just be a rename.)

You can use --include and --exclude to define your set of files to move to a given folder.

Second, run those commands from AWS cloudshell to run 100% on cloud with minimal latency: https://aws.amazon.com/cloudshell/

Best,

Didier

profile pictureAWS
전문가
답변함 9달 전
  • i will be more clear: i have a main bucket that have 100M event

    i want to move all the file to folders of 10m

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인