Skip to content

Glue Studio - SelectFields not populated

0

I am new to AWS Glue Studio. I am trying out my first project. I am reading and previewing the data successfully in the V_Diagnosis node (see image below). But then, the SelectFields is not getting populated in the next node, see the encircled area in red. What am I doing wrong? I saw a youtube video where this seem to get populated automatically.

Enter image description here

asked 3 years ago491 views
2 Answers
1
Accepted Answer

That list is based on the output schema of the previous node, in some cases the schema can be inferred easily (taken from the catalog or sample files) but in order cases like that the schema has to be set in the source node.
To do that you could edit the output schema of the V_Diagnosis node source but it's much easier (and reliable) to start a Data Previous session on the source, once you can see some sample data, go to the Ouput Schema tab and use button to use the schema of the data preview.
Once you do that, the schema will be propagated to the downstream nodes and you will see fields in the Select Fields.
You only have to do this once (unless the DB table changes) because the schema will be saved when you save the job.

AWS
EXPERT
answered 3 years ago
0

Thank you very much, that worked great. I.e. on the 'Output schema' tab, press the 'Use datapreview schema' button - on the upstream node.

answered 3 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.