Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm attempting to use AWS Data Pipeline to move a CSV file from my computer to AWS Data Lake as a parquet file. I'm unable to finad the exact template to select to migrate from my local...
0
answers
0
votes
88
views
asked a year agolg...
i want to directly move a csv file from my laptop to aws data lake using aws pipeline?
is it possible to so ? if yes how?
1
answers
0
votes
351
views
asked a year agolg...
Hey,
My ETL Glue job is:
1. reading from Data Catalogue (S3 based),
2. selecting specific fields from the input file (which is json)
2. doing some mapping
3. saving output data to Postgres Aurora...
2
answers
0
votes
355
views
asked a year agolg...
Hello, I am running a job to apply an ETL on a semi-colon-separated CSV on S3, however, when I read the file using the DynamicFrame feature of AWS and try to use any method like `printSchema` or...
1
answers
0
votes
1865
views
asked a year agolg...
Is there a way to query a Microsoft SQL Server programmatically in a python job shell in AWS Glue?lg...
We have been able to connect to a Microsoft SQL Server DB using both Glue's DynamicFrame and Spark's own JDBC write option due to the Glue connection option. However, considering the transactional...
1
answers
1
votes
1343
views
asked a year agolg...
Hello
I have JSON files for jobs created and extracted from Amazon transcribe and I need to add it to cloud formation stack of PCA
so I found that on my PCA(post call analytics) dashboard there is...
1
answers
0
votes
254
views
asked a year agolg...
Aws interface issuelg...
I am trying to download a dataset from S3 bucket using aws interface.
I have the security code and other details.
But when I type the code for downloading the data, I get an error.
I am not even...
1
answers
0
votes
204
views
asked a year agolg...
```
2023-03-10 03:52:55,572 ERROR [stream execution thread for [id = bea7911a-d787-44e1-836b-8488a43e16ea, runId = ba5fb563-91a6-4d39-befb-f740a9be9a08]] streaming.MicroBatchExecution...
0
answers
0
votes
57
views
asked a year agolg...
Error to view tablelg...
After using a crawler to create a table it shows the following error which I don't know how to fix.
![Error](/media/postImages/original/IMr9UNFbk4Q-qth24BoQLcPQ)
1
answers
0
votes
264
views
asked a year agolg...
Hi,
I have noticed that when running the DataBrew recipe job for data masking, the job is failing when the parquet file has a single record in it.
The error is following:
> "Exception: Error: Unable...
1
answers
0
votes
533
views
asked a year agolg...
New to glue and athena.
I have a great toy example by an AWS community builder working. But in my real use case, I want to capture all the fields from an eventbridge event 'detail' section and...
1
answers
0
votes
232
views
asked a year agolg...
Trying to surface daily csvs in S3 in Redshift via AWS Glue Studio but databases aren't showing uplg...
I am trying to use the AWS Glue Studio to build a simple ETL workflow. Basically, I have a bunch of `csv` files in different directories in S3.
I want those csvs to be accessible via a database and...
1
answers
0
votes
229
views
asked a year agolg...