AWS Athena Notebook - how to import PySpark Libraries

Can I import the PySpark MLLIB library into an Athena Notebook? If so, can you explain the steps? Do I use a jar file to setup during configuration of the individual notebook? It wasn't working for me. Thanks!

主題

分析機器學習與 AI

標籤

Amazon Athena 機器學習與 AI

語言

English

kfure

已提問 6 個月前檢視次數 381 次

1 個回答

最新
最多得票
最多評論

這些答案是否有幫助？支持正確答案，以幫助社區從您的知識中受益。

Hi,

Unfortunately, the MLlib (Apache Spark machine learning library) is not supported now. For a list of supported Python libraries, see the List of preinstalled Python libraries.

Reference: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html

Vlad

已回答 6 個月前

kfure
6 個月前
Could we make an official request to have the PySpark ML-Lib added (with all modules) or a way that we can install it ourselves? We work in PySpark with Big Data and need to do ML Exploration in Athena Notebooks. Let me know. Thanks!

AWS Athena Notebook - how to import PySpark Libraries

相關內容