Bedrock fine tuning ValidationError

The error indicates that after preprocessing, the number of examples in the training file dropped below the minimum required for model training. A few things to check:

1. Make sure the training file contains at least 32 valid examples after preprocessing. Empty or duplicate rows get removed during this step.
2. Check that the format of each example is valid as per documentation. Each example should contain 'prompt' and 'completion' fields with required data.
3. Try increasing the number of examples in the training file. AWS recommends a minimum of 1000 examples for optimal model performance.

Referring to the AWS documentation on data format and requirements can help troubleshoot issues with example count or format causing validation errors. Let me know if preprocessing the data differently helps resolve the error.

• https://docs.aws.amazon.com/sagemaker/latest/dg/autopilot-llms-finetuning-data-format.html
• https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-foundation-models-fine-tuning-instruction-based.html

In addition to the above suggestions, if the issue persists at your end please feel free to open a case with AWS Premium Support for further investigation.