使用 AWS re:Post 即表示您同意 AWS re:Post 使用條款
AWS re:Postre:Post

Line magics in Glue Docker container not found

0

I am interested particularly in %additional_python_modules and I always get this error:

UsageError: Line magic function %additional_python_modules not found.

The same error is thrown when I try other magics:
UsageError: Line magic function %idle_timeout not found.
UsageError: Line magic function %worker_type not found..

I'm using amazon/aws-glue-libs:glue_libs_4.0.0_image_01 image

主題
分析資料庫
標籤
AWS Glue提取轉換與載入資料
語言
English
siyala
已提問 2 個月前檢視次數 120 次
2 個答案
0
已接受的答案

The magics are for the Glue Interactive session Kernel when used as part of a Jupyter notebook.
It has nothing to do with the docker container. In the container you can just use pip to install dependencies inside it (but will be gone when you stop the container).

profile pictureAWS
專家
Gonzalo Herreros
已回答 2 個月前
  • siyala
    2 個月前

    Thanks, Gonzalo. Understood. However, I'm trying to install my own wheel package, for e.g.:

    %additional_python_modules s3://library/simple_salesforce-1.12.1-py2.py3-none-any.whl

    but the above error is thrown for the %additional_python_modules or any other for that matter. The same magics work inside of a Jupyter notebook when run in an interactive session

  • Gonzalo Herreros 專家
    2 個月前

    Yes, as I said magics only make sense inside of a Jupyter notebook when run in an interactive session

0

to close this one, I uploaded my package to PyPI and now I can import it into my notebook running in Docker. Thank you!

siyala
已回答 2 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋，同時有助於提問者的專業成長。

回答問題指南

相關內容