By using AWS re:Post, you agree to the Terms of Use
/Connect to RDS postgres database in GLUE script/

Connect to RDS postgres database in GLUE script

0

I would like to connect to the RDS postgres database with Glue script written in scala, I have a postgres driver located in S3 and added in script in Dependent JARs path. After running the script it fails with the message Glue ETL Marketplace - Retrieved no ETL connector jars, this may be due to no marketplace/custom connection attached to the job or failure of downloading them, please scroll back to the previous logs to find out the root cause. I cannot find any related logs helping me to understand why there is a problem and I receive a Compilation error.

1 Answers
1

Hi,

any specific reason why you are not using the native Glue connection which supports RDS PostgreSQL?

Glue 2.0 uses the driver 42.1.0 and Glue 3.0 uses 42.2.18 (see in this section of the documentation or in this other one).

If you really need to bring your own connector, have you followed the documentation or this blog post as an example?

can you share an anonymised version of the code snippet that contains the setup for the customJDBCDriverJsonOptions ?

hope this helps

EXPERT
answered a month ago
EXPERT
reviewed a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions