By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

upgrading to latest version of transformers for machine learning in sagemaker?

0

I'm running some experiments which requires transformer version greater than 4.17. to upgrade to latest , can i simply install newer version in my own container ?

Dockerfile

FROM 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04

RUN pip install 'transformers==4.24.0'
Topics
Machine Learning & AI
Tags
AWS Deep Learning ContainersAmazon SageMakerMachine Learning & AI
Language
English
clouduser
asked 8 months ago275 views
1 Answer
0

Hi,

The more canonical way to do such update in Python is to use the file 'requirements.txt' (that should probably also be present in your image at top of your python project) and update the project with the version you need and then run pip install -r requirements.txt.

See https://learnpython.com/blog/python-requirements-file/ for more details

Best,

Didier

profile pictureAWS
EXPERT
Didier_Durand
answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content