Searching the right ETL Tool for transferring data within aws

0

Hello everybody, I'm working for a small retail company, where we want to move our data to aws. Our data can be from different sources (postgresDB, MySQL DB or other unstructured data sources or APIs). We want to move from our on prem solution, to aws cloud.

We are currently using an ETL solution, like ab initio. We do not use a code based solution like python or other scripting language. That's why we prefer an ETL solution, where we can just create ETL processes via drag and drop.

Is anybody here who can give his / her recommendations for an ETL Tool, for transferring data from several kind of sources (structured / unstructured data on prem)? We prefer a solution outside from aws (not glue). Thank you very much.

2개 답변
1

Hi, you should have a detailled look at DMS and its CDC features: https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.html

Its full export and CDC features will probably do what you're looking for.

Otherwise AWS Glue is our ETL that may also be a good solution: https://aws.amazon.com/glue/

profile pictureAWS
전문가
답변함 일 년 전
  • Thanks for your answer. We don't want to be limited by databases. We want to extract data from several kind of sources (not only databases). That's why DMS wouldn't work for us. And we also don't want to work only with glue. We prefer a low code option. That's why we use an ETL solution like ab initio, to extract every kind of sources with just one tool. Are there any kind of recommendation of using an external ETL tool in AWS?

1

Hi , I understand you are looking for partner solutions for data integration, while I cannot advice on the best solutions, you can see all AWS partner solutions in this page , on the left under Categories filter for Data Integration and Preparation and you will see all partners who offer tools for ETL type workload.

Two Additional considerations:

  1. for the ingestion part , ingesting from APIs and SaaS you could also look at Amazon Appflow (no code solution)
  2. while I understand you do not want to use coding solutions and for that reason you are not really considering AWS Glue, I would recommend giving it a second try because with the new visual transforms and Connector Marketplace does allow for most thing to be done in a no-code approach. hope this helps
AWS
전문가
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인