unable to create AWS Bedrock continued pretrained as batch the allowed size parameter is larger than the limit

Question

For some reason when creating pretrained model with Amazon Titan Express model as source model and when selecting hyperparameters it shows the allowed batch size as 8 is the minimum while the limits tell it needs to be 1 maximum “BatchSize <= 1”
 
This was not happening before but now it is not allowing me to create pretrained model for this batch size parameter limit, possible value,

Answer

Dear Customer,

Thank you for contacting us regarding the issue with selecting the batch size parameter in Bedrock. I understand that you encounter an issue with the limited options currently available in the console.

As per the public doc[1], The valid range for the batch size is 1-64, however the console currently only allows selections between 8, 16, 24, and 32. As a workaround, you can use the CLI or Python SDK to specify any value in the full valid range when starting a continued pre-training job. I've included the useful code sample link[2] here.

I hope above information is helpful. Thanks for contacting Amazon Web Services.

--- References ---

[1] https://docs.aws.amazon.com/bedrock/latest/userguide/cm-hp-titan-text.html

[2] https://docs.aws.amazon.com/bedrock/latest/userguide/model-customization-code-samples.html

unable to create AWS Bedrock continued pretrained as batch the allowed size parameter is larger than the limit

Relevant content