Questions tagged with AWS Step Functions
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
462
views
asked a year agolg...
Planning to build a Java (Spring Batch) based service (hosted in ECS) to sync data between two databases (A& B) in certain intervals. Expected no of records to be fetched from A likely less than 10K....
1
answers
0
votes
236
views
asked a year agolg...
Hello
I'm in the process of building a custom data pipeline using AWS Step-functions which would call different aws batches. I would like to run all of this locally in order to iterate fast and make...
1
answers
0
votes
957
views
asked a year agolg...
Trying to perform a DynamoDB scan and Filter in a Step Function, but the filter matches no items.
My Task is;
```
"Scan (2)": {
"Type": "Task",
"Parameters": {
"TableName":...
2
answers
0
votes
1175
views
asked a year agolg...
I'm trying to query a DynamoDB table in a Step Function but it's throwing the following error.
Query condition missed key schema element: Scope (Service: DynamoDb, Status Code: 400, Request ID:...
1
answers
0
votes
762
views
asked a year agolg...
I tried to write a step function which upsert a DNS A record on Route 53. However, the field TTL is not supported by step function:
```
"cause": "An error occurred while executing the state...
2
answers
0
votes
620
views
asked a year agolg...
Hi there,
I am trying to do some experiments to migrate from the data pipeline to the step function.
I call the step function from the lambda function by passing a couple of parameters (name, env)....
1
answers
0
votes
3506
views
asked a year agolg...
Hi, We would like to trigger events based on when an instance (EC2 or OnPrem) is registered in Systems Manager, an example, would be to trigger an instance tagging mechanism so that tags are applied...
3
answers
0
votes
877
views
asked a year agolg...
Hello,
Within step function, I want to pass parameters received from input to a Glue:ListCrawler state to run related crawlers inside a Glue and after running all crawlers, I also need to pass the...
1
answers
0
votes
1656
views
asked a year agolg...
Hi there,
in a step function tutorial by AWS (https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-get-started-parallel-tasks.html) I am asked to create a Lambda function in Node.js 16.x...
1
answers
0
votes
404
views
asked a year agolg...
How to get the "RuleResults" generated by a glue studio job that have some dataquality rules, in the dataQuality Tab of the job i can manually download the results to a file when appears the...
1
answers
0
votes
375
views
asked a year agolg...
Hi there,
I'm doing this tutorial: https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-get-started-create-first-sm.html
**There I need to create a Lambda Function in Node.js 16.x, this...
2
answers
0
votes
1558
views
asked a year agolg...