Custom Solution or ETL?

0

Planning to build a Java (Spring Batch) based service (hosted in ECS) to sync data between two databases (A& B) in certain intervals. Expected no of records to be fetched from A likely less than 10K. The service is expected to retrieve, process and insert the delta data into B.

I choose to go with above said custom solution rather than ETL tools as the data volume is considerably less. On second thought, should AWS Glue be a proper fit for this requirement? Or are there any other AWS services better than both?

Your input is much appreciated.

1 Answer
0

Hi, there are multiple option available for your use cases. AWS Glue: it could do the sync job but, as you mention, given the size of the data that need to be handled I would recommend the following options:

To conclude, given that Amazon DMS with a CDC task is meant to be used for continuous replication, it is likely to be more expensive of a solution running on Lambda Function triggered with low frequency; for this reason I would recommend to use the AWS Lambda approach. https://aws.amazon.com/lambda/pricing/ https://aws.amazon.com/dms/pricing/

AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions