AWS Athena Notebook - how to import PySpark Libraries

0

Can I import the PySpark MLLIB library into an Athena Notebook? If so, can you explain the steps? Do I use a jar file to setup during configuration of the individual notebook? It wasn't working for me. Thanks!

1 Risposta
0

Hi,

Unfortunately, the MLlib (Apache Spark machine learning library) is not supported now. For a list of supported Python libraries, see the List of preinstalled Python libraries.

Reference: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html

AWS
Vlad
con risposta 6 mesi fa
  • Could we make an official request to have the PySpark ML-Lib added (with all modules) or a way that we can install it ourselves? We work in PySpark with Big Data and need to do ML Exploration in Athena Notebooks. Let me know. Thanks!

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande