1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
When generating text with large language models in AWS Bedrock, you may encounter read timeout errors from the botocore client used to communicate with the Bedrock endpoint. This is because large model queries can take longer to process and return a response, potentially exceeding the default botocore read timeout.
To prevent read timeouts, you can increase the botocore read timeout configuration. Here is an example of increasing the read timeout to 1000 seconds:
from boto3 import client
from botocore.config import Config
config = Config(read_timeout=1000)
client = boto3.client(service_name='bedrock-runtime',
region_name='us-east-1',
config=config)
beantwortet vor 3 Monaten
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
- AWS OFFICIALAktualisiert vor einem Jahr