2 Answers
- Newest
- Most votes
- Most comments
0
Does this module work without a GPU in the execution environment?
If a GPU is required, it would not be available in Lambda.
0
Hi diegodavila,
It seems your code uses pytorch and also requires GPU support as well. That's why you are getting an error related to cuda. Please check whether you can run your code without GPU support.
Currently Lambda runtime does not support GPU. If you do require GPU, you can consider using containers services such as Amazon Elastic Container Service (Amazon ECS), Kubernetes, or deploy the model to an Amazon SageMaker endpoint.
answered 10 months ago
Hi Bumuthu, how can I check if I can run this Lambda Function without GPU support?
Relevant content
- asked 4 months ago
- asked 5 months ago
- AWS OFFICIALUpdated 10 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated a year ago
Hi Riku, how can I check if this module work without a GPU in the Lambda execution environment?
A good place to start would be to create a sample Python script and see if it works on an EC2 without a GPU.
did you ever get this working? We are attempting to do something similar, and would be happy to work with you to help debug this and see if we can get this working as a lambda function. I've gotten Whisper working inside an Anaconda Notebook on an M2 Macbook Air, but that does have a built in GPU, and I'm not entirely sure on what hardware the code is executing. Would love to get this deployed to Lambda.