How to create a continuous flow of forecast?

Question

Hello:  After playing a little bit with AWS Forecast, and starting seeing some good results, I would like to understand the Full Forecasting Flow, to see how I could put this into production...
It seems that the flow starts once we accumulate enough data to start training the predictor, which can be trained for let's say 7 days, and once the model is ready, I can create the forecast for the next 7 days and consume this. 
But what about the following 7 days? I see the model does not allow to create forecast for these following 7 days.... so what are the next steps? Do we need a new model, or re-train the current one? Do we need to feed the real data from the last week? I'm not clear about this and the best way to create a continuous flow of forecast.
I would appreciate any comment on this.
Thanks

ljunkai · Answer

Hi User,

You will need to set up an automated workflow to continuously ingest the latest data and make predictions with the new data. As this is a time series problem, it can only make predictions with the most recent x timeframe of data. Here is an Architecture that suggests how such a workflow can be setup on AWS

![Enter image description here](/media/postImages/original/IMYyEWry6qSBmUtb_5Nj2u2g)

Link to the blogpost: [https://docs.aws.amazon.com/forecast/latest/dg/tutorial-cloudformation.html](https://docs.aws.amazon.com/forecast/latest/dg/tutorial-cloudformation.html)

Minimally, you should have the following setup:
1. Publishing of new data into S3
2. Lambda function that get triggers when new object is put into S3, make predictions with the new data, and send it to SNS
3. Your applications can subscribe to the SNS to receive the next time period's prediction

You can enhance your workflow to continuously train and evaluate your model, or integrate with other services for analysis etc as shown in the diagram.

Hope this information is helpful in your exploration of setting up an automated forecasting workflow on AWS!

How to create a continuous flow of forecast?

Relevant content