Unanswered Questions tagged with Amazon SageMaker
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I've build a document based chatbot with sagemaker llama 2-7b model with Kendra index which is giving the answer but at the end it is adding 'don't know'.
but using same sagemaker model with faiss it...
0
answers
0
votes
277
views
asked 4 months agolg...
I have some questions regarding async inference of sagemaker model packages on aws marketplace
1. When packaging a model as a sagemaker model package to be offered on marketplace, can it support...
0
answers
0
votes
377
views
asked 4 months agolg...
based on examples here to create a batch inference job in sagemaker -...
0
answers
0
votes
90
views
asked 4 months agolg...
```
import chainlit as cl
@cl.on_message
async def main(message: cl.Message):
# Your custom logic goes here...
# Send a response back to the user
await cl.Message(
...
0
answers
0
votes
42
views
asked 4 months agolg...
I'm having some troubles with fine-tuning Mistral 7b on JumpStart.
This is the error:
```
ErrorMessage "raise ValueError(
ValueError: DeepSpeed Zero-3 is not compatible with...
0
answers
0
votes
353
views
asked 4 months agolg...
I stumbled upon this error when invoking the streaming endpoint using boto3:
```
An error occurred (ModelStreamError) when calling the InvokeEndpointWithResponseStream operation: Your model primary...
0
answers
0
votes
52
views
asked 4 months agolg...
Hi,
I am trying to run an SQL query from sagemaker R kernel notebook.
I have connected to db using rJDBC and this works:
```
show_databases <- dbGetQuery(conn, "show...
0
answers
0
votes
118
views
asked 5 months agolg...
Hi,
I am trying to set up an XGBoost estimator as following
```
estimator = XGBoost(
entry_point="code/train_sagemaker.py",
role=role,
instance_count=1,
instance_type="ml.m5.large",...
0
answers
0
votes
51
views
asked 5 months agolg...
AWS Endpoint Failurelg...
Hello, I've been trying to make an endpoint to my model that was traind, it's cnn/gru tensorflow model, while creating endpoint using the following code, first is for conversion to .tar.gz, and after...
0
answers
0
votes
237
views
asked 5 months agolg...
I'm hoping I can get some guidance/confirmation on this design.
I would like to enable access for all SageMaker components (notebooks, training and hosting instances) over a private network from the...
0
answers
0
votes
63
views
asked 5 months agolg...
I'm deploying an LLM that uses huggingface transformers on Sagemaker with custom inference code (e.g. custom model_fn, predict_fn, etc). I know that Sagemaker has support for response streaming, and...
0
answers
0
votes
126
views
asked 5 months agolg...
Traceability and Reproducibility of Models Generated using SageMaker Training Jobs with S3 Datasetlg...
I have a dataset in S3 bucket which is passed as input to the SageMaker training job. The default **traceability** in SageMaker provides only the S3 URI and doesn't include the version details. If at...
0
answers
1
votes
219
views
asked 5 months agolg...