Using AWS Glue to transform data from DynamoDB to Redshift.

0

Hello everyone,

I'm new with AWS Glue. I'm doing a lab to move data from DynamoDB to Redshift with AWS Glue and my job does not succeed.
I test several times but none of them works (assume that IAM roles are correct).

With Dynamodb:

  • Do I need to create a connection to dynamodb using JDBC ? (It's weird because at connection access there is no username or password to fill in).
  • I need to create the data target first or just create it while add job?

With Redshift:

  • After creating cluster, should I add table into public schema or just leave it as default?
  • Do I need a S3 Endpoint to complete the lab? ( because It requires a S3 endpoint to test connection successfully)

Any suggestions about this case is a big help for me.
Thanks,
natuan

natuan
질문됨 5년 전886회 조회
3개 답변
0

I figured it out, in my case I created a data target but not the same database name, just create new job with right database name.

natuan
답변함 5년 전
0

Need a S3 Endpoint (S3 Gateway)

natuan
답변함 5년 전
0

FYI, there's a solution to move from DDB to Redshift to create source-similar tables without the use of glue:

https://repost.aws/articles/ARlyMMJAeUQLWZd8p3c1Jz6A/automated-change-data-capture-cdc-data-ingestion-from-dynamodb-to-redshift

profile pictureAWS
전문가
Rajiv_G
답변함 5달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠