Sage Maker Notebook - overcommit_memory settings - permission denied

0

I am doing some NLP work using spaCy in a ml.p2.xlarge notebook instance in sagemaker.

However, I get the following error:

numpy.core._exceptions._ArrayMemoryError: Unable to allocate 3.10 GiB for an array with shape (2889884, 288) and data type float32

To fix the issue, I have tried the following commands:

!echo 1 | sudo tee /proc/sys/vm/overcommit_memory
!echo 1 > /proc/sys/vm/overcommit_memory

Neither of them work and they both return:
/bin/sh: /proc/sys/vm/overcommit_memory: Permission denied

Any suggestions? I even added all policies with "admin" in them to the notebook IAM with no luck.

질문됨 3년 전879회 조회
1개 답변
0

Okay, it seems that I needed to restart my notebook after adding the admin policies to it. It's working now and I can overcommit the memory!

답변함 3년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠