Step Function as AppFlow Source

0

We have a need for some Amazon AppFlow Custom Connectors that will perform REST API GET responses. We're looking at using Step functions so that we can run additional API calls based on the response of the first API call. We came across AppFlow and it has a variety of destinations that we are planning on integrating with (such as Snowflake) so we're wondering if we can create a Step Function and use that as the source in AppFlow and Snowflake as our destination?

asked 8 months ago373 views
1 Answer
0

Hello!

I am assuming the flow of the request as below -

StepFunction -> AppFlow -> SnowFlake

For these AppFlow API actions - You can specify resource as arn:aws:states:::aws-sdk:appflow:[apiAction] as per the Step Functions' AWS SDK integrations and place the necessary API calls from workflow.

You can refer to this blog post as well.

For other public API endpoints - Unfortunately, Step Functions as of now does not support integration with any 3rd party service or API endpoints. Hence, you can integrate Step Functions with any of the below AWS services (as per your requirement) to act as a proxy and place the requests to the other APIs -

  1. Glue job - https://docs.aws.amazon.com/step-functions/latest/dg/connect-glue.html
  2. Lambda function(s) - https://docs.aws.amazon.com/step-functions/latest/dg/connect-lambda.html
  3. API Gateway - https://docs.aws.amazon.com/step-functions/latest/dg/connect-api-gateway.html

Because AWS Resource ARNs are required for creating a state machine task, the most likely solution for this use case will involve a state machine calling a Lambda function/Glue/API Gateway that can be implemented to call the Snowflake/Appflow API (if required and not available in the SDK integrations list).

Flow could be like -

Step Functions ==> Glue/Lambda ==> Snowflake/Appflow (for Other Public APIs)

You can refer to this link for more details on AppFlow to Snowflake integration.

If there are any other queries specific to your setup, we would require details that are non-public information. Please open a support case with AWS using the following link

AWS
SUPPORT ENGINEER
answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions