Questions tagged with Amazon SageMaker
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I tried to run Mixtral_8x7b on AWS SageMaker 192 GB GPU and the instance name is ml.g5.48.xlagre.
but it's still running slow.
132 seconds for 200 tokens.
![Enter image description...
1
answers
0
votes
393
views
asked 4 months agolg...
Hello everyone,
I'm currently working on a project where I have a set of Python scripts that train a variety of models (including sklearn, xgboost, and catboost) and save the most accurate model. I...
2
answers
0
votes
467
views
asked 4 months agolg...
I am using [bring your own model](https://sagemaker.readthedocs.io/en/stable/frameworks/pytorch/using_pytorch.html#bring-your-own-model) docs to deploy my trained model on aws sagemaker endpoint. I am...
1
answers
0
votes
360
views
asked 4 months agolg...
I need to fine-tune a stability AI's SDXL model in bedrock how can we that?
1
answers
0
votes
524
views
asked 4 months agolg...
Hi,
We have a step-function state machine that includes launching a batch transform job for inference. When I try to launch multiple instances for inference, the job raises an ambiguous error...
0
answers
0
votes
198
views
asked 4 months agolg...
I have a pytorch model deployed on p3.2xlarge, connected to lambda and api gateway.
When multiple requests are sent to it, based on logs, it accepts them sequentially. There is no concurrency. But...
1
answers
0
votes
394
views
asked 4 months agolg...
# tl;dr
1. I have added a custom logger.debug("### calling modelfn.") into my model_fn.
2. the custom logger is inconsistently showing or not-showing in cloud-watch (despite no change on my side).
#...
0
answers
0
votes
239
views
asked 4 months agolg...
Hi!
I am trying to create a role through the IAM console for an AWS service. Use case is SageMaker. I am following [this...
2
answers
0
votes
310
views
asked 4 months agolg...
When I used Juypter to run Bert model from huggingface, it reported this and then the notebook did and restarted.
Detected kernel version 4.14.334, which is below the recommended minimum of 5.5.0;...
0
answers
0
votes
229
views
asked 4 months agolg...
All of the available images in Amazon are several gigs,? Is there a small lightweight image I can use for running data processing job ?
1
answers
0
votes
264
views
asked 4 months agolg...
I am thinking of storing image embedding in a feature store and use the AWS Rekognition custom label and I am weighing whether it is better to store frames/embeddings/image hashes. But before that I...
1
answers
0
votes
550
views
asked 5 months agolg...
Like the individual who posted this question on the AWS forum, I am also looking to use create_monitoring_schedule. In a record_preprocessor_script file, I want to import various dependent Python...
1
answers
0
votes
258
views
asked 5 months agolg...