upgrading to latest version of transformers for machine learning in sagemaker?

0

I'm running some experiments which requires transformer version greater than 4.17. to upgrade to latest , can i simply install newer version in my own container ?

Dockerfile

FROM 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04

RUN pip install 'transformers==4.24.0'
1 Answer
0

Hi,

The more canonical way to do such update in Python is to use the file 'requirements.txt' (that should probably also be present in your image at top of your python project) and update the project with the version you need and then run pip install -r requirements.txt.

See https://learnpython.com/blog/python-requirements-file/ for more details

Best,

Didier

profile pictureAWS
EXPERT
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions