aws step function invoke with token functionality for invoking aws personalize batch segment job

Not sure what exactly you are asking. If the API you are calling is synchronous, i.e., it blocks until the operation is done and when it returns, you get the answer, there is nothing special you need to do.

If however, the operation is asynchronous, i.e., you get a job ID, you will need to poll for the response by getting into a look that gets the status of the job, checks for completion, and if it did not complete yet, wait a few seconds/minutes and go back.

Specifically with Personalize, if you refer to the create_batch_segment_job, it is asynchrouns, you will need to call describe_batch_segment_job in a loop to get the latest status.

There are a few services that have optimized integrations with Step Functions. With these services you can call the API using .sync in the resource name, and Step Functions will do the loop for you. Personalize is not one of these services.

You also mentioned a token. I am not sure exactly to which token you are refering to. If you are refering to the Wait for task token integration type, you will need someone to call the completion API, and Personalize does't know how to do it.