ASW S3 bucket folder upload/replication app

Question

New AWS user.
I'm looking for a functional application to replicate local folders to S3 buckets.
Already tried using ImageManager, Duplicati, S3 browser.
I need a simple application to do file/folder local computers directly to S3 bucket hot/glacier
can anybody suggest reliable cheapish ready-built applications for this purpose?
Thank you. Jim.

Answer

thank you Sedat. Interesting software products. I'll look into it and trial.

Answer

Thank you, but I'm not looking for a connection tool.  Making a connection is not my issue, as I am not wanting to do a direct backup to a S3 folder. I just want to replicate a local folder to S3 bucket. A straight process, scheduled automated.
I'm looking for an actual application that can schedule/auto replicate, local folder directly into the bucket

Answer

Hi,

I am using rclone for such use cases: https://rclone.org/

```
Rclone has powerful cloud equivalents to the unix commands rsync, cp, mv, mount, ls, ncdu, 
tree, rm, and cat. Rclone's familiar syntax includes shell pipeline support, and --dry-run protection.
 It is used at the command line, in scripts or via its API.

Users call rclone "The Swiss army knife of cloud storage", and "Technology indistinguishable from magic".

Rclone really looks after your data. It preserves timestamps and verifies checksums at all times. 
Transfers over limited bandwidth; intermittent connections, or subject to quota can be restarted, 
from the last good file transferred. You can check the integrity of your files. Where possible, 
rclone employs server-side transfers to minimise local bandwidth use and transfers from one provider 
to another without using local disk.

Virtual backends wrap local and cloud file systems to apply encryption, compression, 
chunking, hashing and joining.

Rclone mounts any local, cloud or virtual filesystem as a disk on Windows, macOS, linux 
and FreeBSD, and also serves these over SFTP, HTTP, WebDAV, FTP and DLNA.
```

It works just fine.

Best,

Didier

Answer

Hello.

How about mounting S3 directly using an S3 mount point?  
It can be used at low cost since it can be used only for the S3 API fee.  
https://github.com/awslabs/mountpoint-s3  
https://aws.amazon.com/jp/blogs/aws/mountpoint-for-amazon-s3-generally-available-and-ready-for-production-workloads/

Answer

as i understand you are looking for just a third party software for backup 
you can check the following tool https://www.msp360.com/backup/
before we were using this tool for our staff/

Answer

It shouldn't be too hard to roll your own. [`aws s3 sync`](https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/sync.html) will keep the local folders synchronised with the target S3 bucket, and you could run this in a scheduler like **cron**, or use something like [**incron**](http://inotify.aiken.cz/?section=incron&page=about&lang=en) to kick-off a new sync job any time a change is made on the source.

ASW S3 bucket folder upload/replication app

Relevant content