By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

AWS Glue Help Wanted - Environment lost Missing gs_unpivot.py and gs_common.py files

0

Hi, I have recently started working with AWS Glue. I have created a Visual ETL job and it ran successfully. I noticed it had somehow created an extra S3 bucket instead of using the desired bucket I had created to store the scripts. In the job details, I changed the paths to use the preferred bucket and re-ran the job. I deleted the original bucket before the job had run and my job failed due to missing gs_unpivot.py and gs_common.py files. These are AWS files as no one in my company has created them (I'm the first to use AWS glue). Where can I now get these files from to restore my environment?

Topics
AnalyticsDatabase
Tags
AWS GlueExtract Transform & Load Data
Language
English
Ian Powell
asked 2 months ago111 views
1 Answer
1
Accepted Answer

Those files are provided by the Glue service on public regional buckets.
When you build a visual job, Glue Studio will automatically add those imports for you, if you copy code that uses those features on your script job, you can to copy the imports as well.
If you lost the visual job, just create and save a new one (on the same region) that uses the transform, once created copy the imports on the "Python library path" on the Job details.

profile pictureAWS
EXPERT
Gonzalo Herreros
answered 2 months ago
profile picture
EXPERT
Oleksii Bebych
reviewed a month ago
  • Ian Powell
    2 months ago

    I've just spoken to a very nice AWS support person who identified the problem was because I was updating the Python import library location in the job details and I should leave that as default unless I have additional libraries to reference.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content