g4dn.xlarge T4 GPU - kernel dead when loading a 7b LLM


I am loading the mistral-7b model from HF Transformers, however, I keep getting kernel dead error on jupyter notebook.

from transformers import AutoModelForSequenceClassification, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")

I am trying to inspect the jupyter.log stream in cloudwatch, however, I do not see any errors specific to the kernels. Where should I be looking for the dead kernel error?

질문됨 2달 전159회 조회
1개 답변

When you see "The kernel appears to have died" message and "Dead kernel" label, please try to run the same code in a Terminal session instead of in a Notebook. Then you could see the error message of the root cause. (Most likely the python process died due to native module crash). You would have to copy & paste Python code cells one by one.

답변함 한 달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인