AWS Athena Notebook - how to import PySpark Libraries

Can I import the PySpark MLLIB library into an Athena Notebook? If so, can you explain the steps? Do I use a jar file to setup during configuration of the individual notebook? It wasn't working for me. Thanks!

主题

分析机器学习和人工智能

标签

Amazon Athena 机器学习和人工智能

语言

English

kfure

已提问 6 个月前381 查看次数

1 回答

最新
投票最多
评论最多

这些答案有用吗？为正确答案投票，以帮助社区从您的知识中受益。

Hi,

Unfortunately, the MLlib (Apache Spark machine learning library) is not supported now. For a list of supported Python libraries, see the List of preinstalled Python libraries.

Reference: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html

Vlad

已回答 6 个月前

kfure
6 个月前
Could we make an official request to have the PySpark ML-Lib added (with all modules) or a way that we can install it ourselves? We work in PySpark with Big Data and need to do ML Exploration in Athena Notebooks. Let me know. Thanks!

AWS Athena Notebook - how to import PySpark Libraries

相关内容