g4dn.xlarge T4 GPU - kernel dead when loading a 7b LLM

0

I am loading the mistral-7b model from HF Transformers, however, I keep getting kernel dead error on jupyter notebook.

from transformers import AutoModelForSequenceClassification, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")
model

I am trying to inspect the jupyter.log stream in cloudwatch, however, I do not see any errors specific to the kernels. Where should I be looking for the dead kernel error?

kev
질문됨 2달 전159회 조회
1개 답변
0

When you see "The kernel appears to have died" message and "Dead kernel" label, please try to run the same code in a Terminal session instead of in a Notebook. Then you could see the error message of the root cause. (Most likely the python process died due to native module crash). You would have to copy & paste Python code cells one by one.

AWS
답변함 한 달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인