AWS Athena Notebook - how to import PySpark Libraries

0

Can I import the PySpark MLLIB library into an Athena Notebook? If so, can you explain the steps? Do I use a jar file to setup during configuration of the individual notebook? It wasn't working for me. Thanks!

kfure
demandé il y a 6 mois381 vues
1 réponse
0

Hi,

Unfortunately, the MLlib (Apache Spark machine learning library) is not supported now. For a list of supported Python libraries, see the List of preinstalled Python libraries.

Reference: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html

AWS
Vlad
répondu il y a 6 mois
  • Could we make an official request to have the PySpark ML-Lib added (with all modules) or a way that we can install it ourselves? We work in PySpark with Big Data and need to do ML Exploration in Athena Notebooks. Let me know. Thanks!

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions