Questions tagged with AWS Data Pipeline
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
![.](/media/postImages/original/IMtFz5_gZCQ7e7aT9-QTcUuQ)
1
answers
0
votes
253
views
asked a year agolg...
Hello, when we see the AWS data pipeline console we see a message that AWS is planning to remove access to console by 04/03/2023. So we are checking how can we use the data pipelines from AWS CLI...
1
answers
0
votes
610
views
asked a year agolg...
I am transforming my table by adding new columns using SQL Query Transform in AWS Glue Job studio.
![visual diagram for transformation](/media/postImages/original/IMwcLXRM0iTROC0Uqb5lvOGg)
SQL...
1
answers
0
votes
863
views
asked a year agolg...
I want to run multiple python scripts to run one after another These are connected, what is the best way to do it ( want to use Ec2 Instance)
2
answers
0
votes
803
views
asked a year agolg...
I am looking for a way to share my Terraform-based modern data stack solution, which I have created using various AWS services, with other companies privately via AWS. However, in the future, we might...
1
answers
0
votes
295
views
asked a year agolg...
Where has the option of configuring request and response mapping template gone when creating a resolver for your data source? The way it was done in VTL?
0
answers
0
votes
92
views
asked a year agolg...
I am attempting to deploy a Flask (python3.8) application via AWS Elastic Beanstalk (EB). I was able to successfully deploy the application on a --single EC2 instance configuration in the public...
0
answers
0
votes
110
views
asked a year agolg...
Hi all,
I saw this announcement today:
> Please note that Data Pipeline service is in maintenance mode and we are not planning to expand the service to new regions. We plan to remove console access...
0
answers
0
votes
276
views
asked a year agolg...
Hello , I need to purge all data from dynamodb table except the last 1 year of data .
I do not have a TTL attribute set in the table, what is the best approach to proceed?
IT will cost a lot if I...
1
answers
0
votes
662
views
asked 2 years agolg...
Hi All,
We have multiple sql servers installed on windows on prem environment, now plan is migrate those to AWS RDS.. We are planning to us below method.
1) Native import/Export using S3 and the...
1
answers
0
votes
498
views
asked 2 years agolg...
I'm a beginner in tasks of date engineer.
I have a taks to create a data lakehouse and i'm tryding undestand how to do it using these tools: DMS, S3, Glue and Hudi.
I already created a simple data...
1
answers
0
votes
629
views
asked 2 years agolg...
Hello! I am looking for an equivalent to this solution that MIcrosoft has flaunted called IDP intelligent data platform, it is governance + operations + analytics in one. they flaunt synapse with aml...
0
answers
0
votes
123
views
asked 2 years agolg...