How do you update packages on AWS Glue?

0

In the documentation I can see that we can add additional modules from pip using the following command %additional_python_modules nameOfModule

However, I would like to be using a later version of pandas and pyarrow than the ones currently installed, 1.0.4 and 0.16.0 respectively.

I have tried adding this at the top of the script in a notebook:

%additional_python_modules pandas==1.4.2, pyarrow==8.0.0

As well as passing these as parameters when doing a manual run, however, I still see the version numbers remaining as the standard out of the box versions, is this possible to do?

preguntada hace 2 años76 visualizaciones
No hay respuestas

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas