Questions tagged with AWS Step Functions
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi there,
I just took a backup from dynamoDB using ExportTableToPointInTime but the json has an "Item" object as a top root. Is there anyway I can back it up without the "Item" object as a...
1
answers
0
votes
261
views
asked a year agolg...
I am trying to prototype a pipeline that uses nested workflows in order to build a data processing pipeline. My POC is very very basic.
1. Parent workflow has one state, call the child workflow
2....
1
answers
0
votes
488
views
asked a year agolg...
After the step function got executed, do we have some mechanism to extract the step function graph as svg or png which shows the states got excuted and and states got errored and flow of execution ? I...
2
answers
0
votes
422
views
asked a year agolg...
I understand from this link- https://stackoverflow.com/questions/65968624/aws-step-functions-graph-export-api if we use yaml or json to define the state, we can see the graph in the vs code using aws...
0
answers
0
votes
124
views
asked a year agolg...
I understand from this link - https://docs.aws.amazon.com/step-functions/latest/dg/connect-to-resource.html, the step function provides 3 service integration. First one seems to be straight forward -...
2
answers
0
votes
589
views
asked a year agolg...
aws step function invoke with token functionality for invoking aws personalize batch segment joblg...
We want to trigger the aws personalize item attribute affinity user segment batch job from our application. We are planning to use step function to trigger the batch segment. The batch segment job is...
1
answers
0
votes
256
views
asked a year agolg...
Hi,
I have an EmrActivity step on the data pipeline that backups the dynamoDB and stores it in S3. I would like to use this functionality on a step function or something other than Data Pipeline. If...
1
answers
0
votes
294
views
asked a year agolg...
Some of my Step Functions can have (very) long-running executions, hence the risk of reaching the maximum number of history events (25000) is not neglectable and I am required to manage/track my...
3
answers
0
votes
1058
views
asked a year agolg...
I'm creating a Step function workflow with multiple embedded workflows (using startExecution.sync:2). I noticed that all of the embedded workflows appear to have a 2-3 second overhead. Looking at...
1
answers
0
votes
267
views
asked a year agolg...
Hi,
I'm writing an ETL that before inserting data into S3 needs to clean up the staging area, the staging area also is connected as a data catalog table. Ideally the ETL should:
1- clean S3 folder...
1
answers
1
votes
456
views
asked a year agolg...
Planning to build a Java (Spring Batch) based service (hosted in ECS) to sync data between two databases (A& B) in certain intervals. Expected no of records to be fetched from A likely less than 10K....
1
answers
0
votes
230
views
asked a year agolg...
Hello
I'm in the process of building a custom data pipeline using AWS Step-functions which would call different aws batches. I would like to run all of this locally in order to iterate fast and make...
1
answers
0
votes
939
views
asked a year agolg...