By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Searching the right ETL Tool for transferring data within aws

0

Hello everybody, I'm working for a small retail company, where we want to move our data to aws. Our data can be from different sources (postgresDB, MySQL DB or other unstructured data sources or APIs). We want to move from our on prem solution, to aws cloud.

We are currently using an ETL solution, like ab initio. We do not use a code based solution like python or other scripting language. That's why we prefer an ETL solution, where we can just create ETL processes via drag and drop.

Is anybody here who can give his / her recommendations for an ETL Tool, for transferring data from several kind of sources (structured / unstructured data on prem)? We prefer a solution outside from aws (not glue). Thank you very much.

Topics
Migration & ModernizationDatabaseAnalyticsStorage
Tags
Migration & ModernizationDatabaseData LakesExtract Transform & Load Data
Language
English
SaschaSingh
asked a year ago302 views
2 Answers
1

Hi, you should have a detailled look at DMS and its CDC features: https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.html

Its full export and CDC features will probably do what you're looking for.

Otherwise AWS Glue is our ETL that may also be a good solution: https://aws.amazon.com/glue/

profile pictureAWS
EXPERT
Didier_Durand
answered a year ago
  • SaschaSingh
    a year ago

    Thanks for your answer. We don't want to be limited by databases. We want to extract data from several kind of sources (not only databases). That's why DMS wouldn't work for us. And we also don't want to work only with glue. We prefer a low code option. That's why we use an ETL solution like ab initio, to extract every kind of sources with just one tool. Are there any kind of recommendation of using an external ETL tool in AWS?

1

Hi , I understand you are looking for partner solutions for data integration, while I cannot advice on the best solutions, you can see all AWS partner solutions in this page , on the left under Categories filter for Data Integration and Preparation and you will see all partners who offer tools for ETL type workload.

Two Additional considerations:

  1. for the ingestion part , ingesting from APIs and SaaS you could also look at Amazon Appflow (no code solution)
  2. while I understand you do not want to use coding solutions and for that reason you are not really considering AWS Glue, I would recommend giving it a second try because with the new visual transforms and Connector Marketplace does allow for most thing to be done in a no-code approach. hope this helps
AWS
EXPERT
Fabrizio@AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content