Unanswered Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Started getting this error today when querying data from Athena in a table created from parquet files in our S3 bucket:
![Enter image description...
0
answers
0
votes
100
views
asked a year agolg...
I'm attempting to use AWS Data Pipeline to move a CSV file from my computer to AWS Data Lake as a parquet file. I'm unable to finad the exact template to select to migrate from my local...
0
answers
0
votes
86
views
asked a year agolg...
```
2023-03-10 03:52:55,572 ERROR [stream execution thread for [id = bea7911a-d787-44e1-836b-8488a43e16ea, runId = ba5fb563-91a6-4d39-befb-f740a9be9a08]] streaming.MicroBatchExecution...
0
answers
0
votes
57
views
asked a year agolg...
I do a crawler to load all my S3 csv files to Glue Data Catalog. Now I want to create a glue job to execute ETL (create and drop temporary tables, select and insert data to tables in Data Catalog) But...
0
answers
0
votes
56
views
asked a year agolg...
I have noticed that my AWS Step Function freezes after previous run has been aborted with some jobs still left in the pending state.
The use case:
I have a step function that increments through the...
0
answers
0
votes
71
views
asked a year agolg...
All,
I recently updated an AVRO Schema. I have checked that the updates made to the schema are backward compatible; and they are. Next, I saved an avro file w/ the new schema to an s3 Bucket and...
0
answers
0
votes
48
views
asked a year agolg...
Architecture: Glue DataBrew for product catalog preperation/cleansing before import to magento?lg...
Each supplier provides me with their product data in their own format, so I need to map them in order to import the data into Magento.
As the product data needs to be updated frequently, I'm...
0
answers
0
votes
87
views
asked a year agolg...
I've tried to UNLOAD() data from MySQL to S3 by Athena engine 3 and got an error: __INVALID_SESSION_PROPERTY: Unknown session property ***.manifest_location.__
*** - this is my Data source.
But it...
0
answers
0
votes
97
views
asked a year agolg...
Cron job Problem it is work monday to friday but this is stop staturday and sunday please help for this problem
0
answers
0
votes
99
views
asked a year agolg...
Hi,
I retrieve data each hour from an API. Data are statistical informations about cities. Until today I was storing the data as parquet in a S3 bucket with two partition : the day and the hour....
0
answers
0
votes
54
views
asked a year agolg...
We use DMS to export data from MY SQL to S3 post which we run ETLs. The Glue ETLs use bookmarks hence reads only what has changed from the last time it ran . However the raw data keeps increasing in...
0
answers
0
votes
66
views
asked a year agolg...
Hi there,
i'm just able to see two out of four columns in athena. I don't know the reason but could it be because of my glue schema version? I tried changing the precicision and scale number but it...
0
answers
0
votes
130
views
asked a year agolg...