Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi, i have a crawler that connects by jdbc to a snowflake and the process finishes well, but it doesn't create any table, here the output of the cloudwatch:
BENCHMARK : Classification complete,...
2
answers
0
votes
369
views
asked a year agolg...
At present, Glue supports the iceberg framework, but the MERGE INTO syntax is needed here. I set it according to the official website's article, but I can't succeed. There will always be an error of...
0
answers
0
votes
75
views
asked a year agolg...
I need to insert a dynamicFrame created by reading a table from Redshift to RDS and the frame includes a column has string values in Korean. My target DB's default encoding is not utf-8, so I needed...
1
answers
0
votes
398
views
asked a year agolg...
Hi. I'm building up/developing a pipeline in AWS using AWS Glue.
**Context:**
I'm extracting data from RDS AWS Postgres instance. This instance is a productive database of a mobile app...
1
answers
0
votes
409
views
asked a year agolg...
Hi, it seems that sometime in the past couple of weeks, the ability to rename a partition column in a Glue table created by a crawler has been removed.
The [documentation...
2
answers
1
votes
1206
views
asked a year agolg...
Hi, I am using the Sagemaker to custom a data labeling workflow, which requires to process data based on the default order from the manifest file. I found that currently the Sagemaker fetch source...
0
answers
0
votes
75
views
asked a year agolg...
I have JSON data stored on S3 which I have created Glue tables over. This data is partitioned and I use Glue crawlers to update the table partitions. I then load this data as a Glue DynamicFrame...
1
answers
1
votes
491
views
asked a year agolg...
I have an AWS Glue PII data detector job, its taking around 47 minutes to complete for 17.9 MB file size which is very long time for any spark job.
Sharing the code snippet used in the...
1
answers
0
votes
455
views
asked a year agolg...
I have ran the python query to transform the json format to parquet format and it was completed successfully, I can see the parquet file and the columns, but when I try to run the query using Athena,...
2
answers
0
votes
830
views
asked a year agolg...
New to AWS, trying to create a table through glue crawler from a .json file that i uploaded into S3.lg...
Hello, any help would be much appreciated. I have two files that I need to make tables for one is a csv file that I was able to get the table loaded for through glue crawler. The other file i was not...
1
answers
0
votes
1181
views
asked a year agolg...
We have a number of saved report templates and when we look at the generated csv files, there are a few problems.
1. the columns change order randomly
2. in the csv some of the column headers (such...
2
answers
0
votes
266
views
asked a year agolg...
I am using Amazon Kinesis Firehose for converting files from JSON to Parquet leveraging Glue for Table creation.
When the data is blank the glue schema creates a NULL and the conversion at Kinesis...
1
answers
0
votes
2225
views
asked a year agolg...