Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Glue Job - Parameters

0

Hi,

I have a Glue which reads data from Database and database connection details like host, user name and password are stored in AWS secret manager. We have environment specific AWS secret manager and it stores respective environment db details. Similarly we need to stores some other config details like multiple part upload chunk size, threshold value etc.....

Would like to know what is the best way/place to keep all these config values other than keeping it in Job Parameters ?

Topics
Analytics
Tags
AWS Glue
Language
English
asked a year ago475 views
1 Answer
0

Hello Bharath,

Could you see this best practice which i believe will answer your questions :- https://medium.com/@debolek4dem/best-practices-for-storing-configuration-details-in-aws-glue-jobs-11e6e638c328

if this helps kindly accept the answer so others could benefit from this

EXPERT
answered a year ago
EXPERT
reviewed a year ago
  • Bharath
    a year ago

    Excellent Adeleke, Thank you very much !

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content