How to create revisions automatically when a new file is added to S3?

Question

We're posting a product to the data marketplace that covers a dataset that has new data added every hour. While onboarding we were told we could set something up to automatically create a revision each hour to add the new csv containing new data, but haven't seen any info on how to do this. Anybody know the best way to go about setting up a system like this to keep our data up-to-date? Thanks

Answer

Data Exchange supports [automatic revision creation](https://docs.aws.amazon.com/data-exchange/latest/userguide/updating-products.html#dynamically-updated-products) through the console and through `AddRevisions` in the [Catalog API](https://docs.aws.amazon.com/data-exchange/latest/userguide/add-revisions.html).

Answer

Hi loften,  
Thanks for your question.  AWS Data Exchange Publisher Coordinator should be able to help with this.  This solution automates the steps to create a new revision for an existing AWS Data Exchange dataset. Please find the link here: https://aws.amazon.com/solutions/implementations/aws-data-exchange-publisher-coordinator/  
If you have any additional questions, please don't hesitate to reach out!

How to create revisions automatically when a new file is added to S3?

Relevant content