Questions tagged with Amazon SageMaker
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm deploying a custom inference.py on a neural network trained on Sagemaker and stored in S3. One issue is writing the inference.py and debugging as I am creating the endpoint. Each time, I have to...
1
answers
0
votes
186
views
asked 5 months agolg...
```
import chainlit as cl
@cl.on_message
async def main(message: cl.Message):
# Your custom logic goes here...
# Send a response back to the user
await cl.Message(
...
0
answers
0
votes
47
views
asked 5 months agolg...
Hi,
A code on sagemaker pipeline script is throwing an error related to 'is_s3express_bucket'.
The code:
subprocess.check_call([sys.executable, "-m", "pip", "install", "--upgrade",...
2
answers
0
votes
3586
views
asked 5 months agolg...
Yesterday, I followed the AIM307 (https://gitlab.com/juliensimon/aim307/-/blob/master/aim307.ipynb?ref_type=heads) tutorial on SageMaker using autoML/AutoPilot. It look maybe an hour to do and in the...
1
answers
0
votes
196
views
asked 5 months agolg...
```
llm = SagemakerEndpoint(
endpoint_name=endpoint_name,
region_name=region,
model_kwargs={"max_new_tokens": 700, "top_p": 0.9, "temperature": 0.6},
endpoint_kwargs={...
2
answers
0
votes
341
views
asked 5 months agolg...
Hi,
I have a sagemaker pipeline (training pipeline) which creates a new version of the ML model on a periodical basis with retraining and pushes that version to model registry inside a studio. I want...
1
answers
1
votes
353
views
asked 5 months agolg...
```
from langchain import LLMChain
from langchain import SagemakerEndpoint
from langchain.prompts import PromptTemplate
from langchain.llms.sagemaker_endpoint import LLMContentHandler
import os
import...
1
answers
0
votes
785
views
asked 5 months agolg...
Hi,
Currently I'm trying to change framework the model is prepared from Tensorflow to Pytorch.
The issue I encounter is long time of request decoding (request with JSON to dict) - it takes around 200...
1
answers
0
votes
164
views
asked 5 months agolg...
Hi, I checked my billing panel this morning to see a large bill for SageMaker, even though we have not been using it this month it is still considerably higher than last month.
I've checked the...
1
answers
0
votes
267
views
asked 5 months agolg...
We are trying to create a Serverless Endpoint at AWS for the Segment Anything (SAM) model. We pulled its image from Docker Hub...
2
answers
0
votes
328
views
asked 5 months agolg...
I was inferring the facebook/opt-350m trained on Dahoas/full-hh-rlhf datatset. But while inferring by asking the questions but the answers are having some garbage value included
Example:
Input query...
1
answers
0
votes
143
views
asked 5 months agolg...
Hey, my company wants to build an LLM using any base models available in Sagemaker/Bedrock. We want to be sure about this if we train a model of our own, then will our training data be sent to the...
1
answers
1
votes
309
views
asked 5 months agolg...