Questions tagged with AWS Step Functions
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Some of my Step Functions can have (very) long-running executions, hence the risk of reaching the maximum number of history events (25000) is not neglectable and I am required to manage/track my...
3
answers
0
votes
947
views
asked a year agolg...
I'm creating a Step function workflow with multiple embedded workflows (using startExecution.sync:2). I noticed that all of the embedded workflows appear to have a 2-3 second overhead. Looking at...
1
answers
0
votes
257
views
asked a year agolg...
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
414
views
asked a year agolg...
Planning to build a Java (Spring Batch) based service (hosted in ECS) to sync data between two databases (A& B) in certain intervals. Expected no of records to be fetched from A likely less than 10K....
1
answers
0
votes
212
views
asked a year agolg...
Hello
I'm in the process of building a custom data pipeline using AWS Step-functions which would call different aws batches. I would like to run all of this locally in order to iterate fast and make...
1
answers
0
votes
888
views
asked a year agolg...
Trying to perform a DynamoDB scan and Filter in a Step Function, but the filter matches no items.
My Task is;
```
"Scan (2)": {
"Type": "Task",
"Parameters": {
"TableName":...
2
answers
0
votes
1089
views
asked a year agolg...
I'm trying to query a DynamoDB table in a Step Function but it's throwing the following error.
Query condition missed key schema element: Scope (Service: DynamoDb, Status Code: 400, Request ID:...
1
answers
0
votes
608
views
asked a year agolg...
I tried to write a step function which upsert a DNS A record on Route 53. However, the field TTL is not supported by step function:
```
"cause": "An error occurred while executing the state...
2
answers
0
votes
568
views
asked a year agolg...
Hi there,
I am trying to do some experiments to migrate from the data pipeline to the step function.
I call the step function from the lambda function by passing a couple of parameters (name, env)....
1
answers
0
votes
3252
views
asked a year agolg...
Hi, We would like to trigger events based on when an instance (EC2 or OnPrem) is registered in Systems Manager, an example, would be to trigger an instance tagging mechanism so that tags are applied...
3
answers
0
votes
759
views
asked a year agolg...
Hello,
Within step function, I want to pass parameters received from input to a Glue:ListCrawler state to run related crawlers inside a Glue and after running all crawlers, I also need to pass the...
1
answers
0
votes
1524
views
asked a year agolg...
Hi there,
in a step function tutorial by AWS (https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-get-started-parallel-tasks.html) I am asked to create a Lambda function in Node.js 16.x...
1
answers
0
votes
376
views
asked a year agolg...