Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello Members,
Please help with below issue,
I am not able to find in documentation
I am trying below :
_____________________________________________
silver_target = glueContext.getSink(
...
2
answers
1
votes
335
views
asked 9 months agolg...
Unable to install External python librarires(e.g.redshift_connector==2.0.913) in AWS Glue Spark Job through Job Parameters option "--additional-python-modules" .
1
answers
0
votes
391
views
asked 9 months agolg...
Hello,
I'm writing a custom transform where I want to use mode within pyspark.sql.functions but I get the same issue irrespective of whether I use * or import the specific module. How can I resolve...
0
answers
0
votes
89
views
asked 9 months agolg...
I am running pyspark on glue 3 notebook. The %additional_python_modules works well in the absence of %connections. But if I add %connections the job ignore %additional_python_modules and doesn't...
1
answers
0
votes
268
views
asked 9 months agolg...
Trying to write the records from S3 text file to Redshit. It running when the record count is around 10000, but running long and further connection timing out when trying to write the entire file (50K...
1
answers
0
votes
189
views
asked 9 months agolg...
I am trying to use Amazon Grafana with files on Amazon S3. For that, I need to change the date format of the original file to fit on Grafana. I use the following command :
SELECT...
1
answers
0
votes
294
views
asked 9 months agolg...
Hi,
I have a list of Glue jobs, they are up and running. Starting from 2023/08/14 I'm having a lot of errors from CoarseGrainedExecutorBackend like this:
**ERROR CoarseGrainedExecutorBackend:**...
1
answers
0
votes
1049
views
asked 9 months agolg...
Hi all, I created a EventBridge rule with the following event pattern that is suppose to match all glue crawler state changes and send them to a lambda function, however, the rule is only only sending...
2
answers
0
votes
776
views
asked 9 months agolg...
Hi,
I am searching for a transformation engine that supports multi-tenancy with the following requirements:
* Each tenant must be transformed every 10 minutes.
* One tenant transformation transforms...
1
answers
0
votes
349
views
asked 9 months agolg...
Hello, we have an S3 bucket with various CSV files and an AWS Glue crawler to update the Data Catalog and finally an AWS Glue job to move the data to RedShift. The handling of data and target table is...
0
answers
0
votes
128
views
asked 9 months agolg...
Hi all. I generated a batch transform. The process finished correctly with no issues. When I check the output data, the directory is empty.
This is the manifest file format (RecordIO)...
1
answers
0
votes
255
views
asked 9 months agolg...
importing form encoded/csv data from data logger using aws api gateway,lamda function and dynamodblg...
greetings, for past few weeks i have been trying to fetch data using a solar data logger using an api gateway that sends data to my api gateway which is integrated to my lamda function but the problem...
4
answers
0
votes
431
views
asked 9 months agolg...