Is it possible to call rest API from AWS glue job
I have rest API, which I need to call from AWS glue job and read some data from it for my transformation. Is it possible to handle that from AWS glue job.
Currently Glue does not have any in built connectors which can query a REST API directly. However if you can create your own custom code either in python or scala that can read from your REST API then you can use it in Glue job.
Case1 : If you do not have any connection attached to job then by default job can read data from internet exposed Rest API directly.
Case2: If you have glue connection attached to job, then make sure you have route of NAT gw in private subnet so that job can read data from Rest API.
trigger glue job from s3Accepted Answerasked 3 months ago
Call a glue Job from within another without using vpc endppoints or SG
Loading json string data as super from Glue job in to Redshiftasked 6 months ago
Glue Catalog API callasked 3 months ago
Is it possible to call rest API from AWS glue jobasked 3 months ago
AWS Glue visual jobasked 2 months ago
Copying data from sql server to snowflake with AWS GLUEasked a month ago
Need inputs on Glue to move data from Aurora MySQL to Redshiftasked 25 days ago
send email from glue jobAccepted Answer
How to retrieve job run id from the script itself in python shell glue jobasked 2 months ago