How to sync big SAP datasources using Appflow

Hello everyone,

I'm currently working on loading heavy SAP datasources, such as 0FI_ACDOCA_10, using Appflow to S3.

Initially, I set up a flow run in incremental loading mode without any filters. However, this approach frequently encountered errors due to network connection issues, timeouts, ...

So, I decided to split the loads into multiple parts, such as one load per week. After that, I set up a schedule using incremental loading mode to run daily and capture new data changes. However, this schedule requires an initial load, which means I need to set a filter to retrieve data equal to or greater than the current month using a date field. Unfortunately, this approach filters out any data changes from previous months, even if they were captured using delta mode.

Ideally, the flow for running incremental loading should be able to capture data changes without the need for an initial load?

If you have any solutions or suggestions for this situation, I would greatly appreciate it.

Thank you.