Questions tagged with AWS Step Functions
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am trying to prototype a pipeline that uses nested workflows in order to build a data processing pipeline. My POC is very very basic.
1. Parent workflow has one state, call the child workflow
2....
1
answers
0
votes
475
views
asked a year agolg...
After the step function got executed, do we have some mechanism to extract the step function graph as svg or png which shows the states got excuted and and states got errored and flow of execution ? I...
2
answers
0
votes
411
views
asked a year agolg...
I understand from this link- https://stackoverflow.com/questions/65968624/aws-step-functions-graph-export-api if we use yaml or json to define the state, we can see the graph in the vs code using aws...
0
answers
0
votes
121
views
asked a year agolg...
I understand from this link - https://docs.aws.amazon.com/step-functions/latest/dg/connect-to-resource.html, the step function provides 3 service integration. First one seems to be straight forward -...
2
answers
0
votes
581
views
asked a year agolg...
aws step function invoke with token functionality for invoking aws personalize batch segment joblg...
We want to trigger the aws personalize item attribute affinity user segment batch job from our application. We are planning to use step function to trigger the batch segment. The batch segment job is...
1
answers
0
votes
252
views
asked a year agolg...
Hi,
I have an EmrActivity step on the data pipeline that backups the dynamoDB and stores it in S3. I would like to use this functionality on a step function or something other than Data Pipeline. If...
1
answers
0
votes
286
views
asked a year agolg...
Some of my Step Functions can have (very) long-running executions, hence the risk of reaching the maximum number of history events (25000) is not neglectable and I am required to manage/track my...
3
answers
0
votes
1026
views
asked a year agolg...
I'm creating a Step function workflow with multiple embedded workflows (using startExecution.sync:2). I noticed that all of the embedded workflows appear to have a 2-3 second overhead. Looking at...
1
answers
0
votes
264
views
asked a year agolg...
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
443
views
asked a year agolg...
Planning to build a Java (Spring Batch) based service (hosted in ECS) to sync data between two databases (A& B) in certain intervals. Expected no of records to be fetched from A likely less than 10K....
1
answers
0
votes
225
views
asked a year agolg...
Hello
I'm in the process of building a custom data pipeline using AWS Step-functions which would call different aws batches. I would like to run all of this locally in order to iterate fast and make...
1
answers
0
votes
926
views
asked a year agolg...
Trying to perform a DynamoDB scan and Filter in a Step Function, but the filter matches no items.
My Task is;
```
"Scan (2)": {
"Type": "Task",
"Parameters": {
"TableName":...
2
answers
0
votes
1120
views
asked a year agolg...