By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

move files from s3 to s3 folder

0

i have s3 name test that have 100m files of jsons. i need to move 10m files to a new folder for that it can spread like this folder1 =10m folder2 =10m folder3 =10m folder4 =10m etc....

Topics
Storage
Tags
Amazon S3 GlacierS3 Transfer AccelerationS3 Object Lock
Language
English
omern
asked 8 months ago925 views
1 Answer
2

Hi,

most efficient way is to use the mv of S3 CLI: https://docs.aws.amazon.com/cli/latest/reference/s3/mv.html to rename your files via move (nothing will move indeed: it will just be a rename.)

You can use --include and --exclude to define your set of files to move to a given folder.

Second, run those commands from AWS cloudshell to run 100% on cloud with minimal latency: https://aws.amazon.com/cloudshell/

Best,

Didier

profile pictureAWS
EXPERT
Didier_Durand
answered 8 months ago
  • omern
    8 months ago

    i will be more clear: i have a main bucket that have 100M event

    i want to move all the file to folders of 10m

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content