Yes, You can use model monitor for data capture and scheduling in your own custom container with the relevant monitoring for NLP use case.
For example, there's a blog post for model monitor for computer vision classification prediction with defined *alert * of predict more than expected.
Relevancy of SageMaker Model Monitor for NLP?Accepted Answer
SageMaker Multi Model EndPoint and Inference Data Capture featureAccepted Answerasked 8 months ago
SageMaker Model Monitor Missing Columns Constraint ViolationAccepted Answerasked 3 years ago
Tracking the lineage between Amazon SageMaker endpoint model and Model Monitor captured dataAccepted Answer
Visualizing custom Model Monitor metrics in Sagemaker Studioasked 8 months ago
Sagemaker Model Monitor - endPointInput:contentType is of type application/octet-streamasked 11 days ago
Does SageMaker Multi-Model Endpoint support SageMaker Model Monitor?Accepted AnswerEXPERTasked 3 years ago
SageMaker Model Registry, Model Monitor and Hyperparameter Tuning jobs - Pricing?Accepted Answerasked 3 months ago
I want to use the model monitor in the sagemaker pipeline to get the results of statistics.json and constraints.jsonasked 2 months ago
NLP with a custom modelAccepted Answerasked 4 years ago