Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a Delta Lake table saved in s3. I am running the following command:
spark.sql("""
CREATE EXTERNAL TABLE db.my_table
USING DELTA
LOCATION 's3://path/to/delta/table
""")
Everything...
2
answers
0
votes
350
views
asked 4 months agolg...
Hello.
I am currently completing the AWS Industry Quest: Financial Industry but I'm unable to do so as 2 modules produce errors that prevent me from continuing. The modules "Securing a Banking Data...
1
answers
0
votes
442
views
asked 4 months agolg...
I have a strange problem.
I created my first Visual ETL job; it runs fine, but there are a few mistakes in the output schema.
The problem is now when I try to open the job, it will not load in...
2
answers
0
votes
334
views
asked 4 months agolg...
Hi folks!
I want to ask can we do insert-update in AWS Glue Visual ETL Job?
I want to use Postgre as DB target and will do insert-update.
Prefers use Visual ETL Job...
1
answers
0
votes
373
views
asked 4 months agolg...
Hi folks!
right now i'm working on project to do ETL Process using AWS Glue. I already create the query script to process the data, but my source data is in Json format. I need help to transform the...
1
answers
0
votes
246
views
asked 4 months agolg...
Hello,
I am trying to add a column to a data set as part of a transformation in an AWS Glue job. I am developing my script locally using interactive sessions and in my session I can see that the code...
1
answers
0
votes
387
views
asked 5 months agolg...
Hi all, I am trying to implement lake formation security on my data lake consisting of bronze, silver, gold zones in s3 and glue catalog tables. The gold zone data also exists in redshift tables with...
1
answers
0
votes
368
views
asked 5 months agolg...
I'm trying to customize a script built via **Visual ETL** and came across a error
Steps I followed
* A DynamicFrame created from csv file present in s3 needs to be evaluated for its data-type
* I'm...
1
answers
0
votes
266
views
asked 5 months agolg...
Hi all, I had a quick question regarding AWS Glue Catalog Tables.
I currently have a crawler that is crawling one folder with 3 files of the same schema. If I want to reduce to just 1 file, would I...
1
answers
0
votes
360
views
asked 5 months agolg...
Hi all, is there any direct way to set up cloudwatch alarms to alert you when a glue job fails? Without using the lambda function. For example, using a direct metric such as...
2
answers
0
votes
701
views
asked 5 months agolg...
During mapping of a few columns from a CSV file in S3 to a Redshift table, I can't change datatype from long to int. The list is empty, and the search is not showing any results either. In the catalog...
2
answers
0
votes
259
views
asked 5 months agolg...
Hey all, I currently have a data file in s3 which i am trying to output to redshift through glue visual studio. My data successfully got sent to redshift tables, but the amount field has changed the...
2
answers
0
votes
225
views
asked 5 months agolg...