Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
how to fix this to execute Jobs from Amazon Glue to Redshift? Error: "JobName:s3-redshift and JobRunId:jr_30d8ac0c6b35d44f641b7d5b55819365897b18e6244c8a5559bff53efc8e23c1 failed to execute with...
2
answers
0
votes
269
views
asked a year agolg...
Delivering records to Security Lake custom source prefix is not possible with Kinesis Firehose?lg...
I'm trying to set up custom sources for Security Lake and have a Kinesis Firehose delivery stream configured to deliver parquet files into the Security Lake bucket under the ext/ prefix.
The problem...
1
answers
0
votes
326
views
asked a year agolg...
Hi, i have a crawler that connects by jdbc to a snowflake and the process finishes well, but it doesn't create any table, here the output of the cloudwatch:
BENCHMARK : Classification complete,...
2
answers
0
votes
374
views
asked a year agolg...
At present, Glue supports the iceberg framework, but the MERGE INTO syntax is needed here. I set it according to the official website's article, but I can't succeed. There will always be an error of...
0
answers
0
votes
75
views
asked a year agolg...
I need to insert a dynamicFrame created by reading a table from Redshift to RDS and the frame includes a column has string values in Korean. My target DB's default encoding is not utf-8, so I needed...
1
answers
0
votes
411
views
asked a year agolg...
Hi. I'm building up/developing a pipeline in AWS using AWS Glue.
**Context:**
I'm extracting data from RDS AWS Postgres instance. This instance is a productive database of a mobile app...
1
answers
0
votes
423
views
asked a year agolg...
Hi, it seems that sometime in the past couple of weeks, the ability to rename a partition column in a Glue table created by a crawler has been removed.
The [documentation...
2
answers
1
votes
1277
views
asked a year agolg...
Hi, I am using the Sagemaker to custom a data labeling workflow, which requires to process data based on the default order from the manifest file. I found that currently the Sagemaker fetch source...
0
answers
0
votes
77
views
asked a year agolg...
I have JSON data stored on S3 which I have created Glue tables over. This data is partitioned and I use Glue crawlers to update the table partitions. I then load this data as a Glue DynamicFrame...
1
answers
1
votes
506
views
asked a year agolg...
I have an AWS Glue PII data detector job, its taking around 47 minutes to complete for 17.9 MB file size which is very long time for any spark job.
Sharing the code snippet used in the...
1
answers
0
votes
471
views
asked a year agolg...
I have ran the python query to transform the json format to parquet format and it was completed successfully, I can see the parquet file and the columns, but when I try to run the query using Athena,...
2
answers
0
votes
839
views
asked a year agolg...
New to AWS, trying to create a table through glue crawler from a .json file that i uploaded into S3.lg...
Hello, any help would be much appreciated. I have two files that I need to make tables for one is a csv file that I was able to get the table loaded for through glue crawler. The other file i was not...
1
answers
0
votes
1216
views
asked a year agolg...