AWS Glue python shell job is supporting only python 3.6, but boto3 is now stopping its support to python 3.6

Question

As per this [aws doc](https://aws.amazon.com/blogs/developer/python-support-policy-updates-for-aws-sdks-and-tools/), boto3 is stopping its support for python 3.6 from May 30, 2022. But in AWS Glue jobs - python shell, glue is supporting only python version 3.6 and its not even allowing us to update the python version. How should I handle my glue jobs now?

Answer

see this answer https://repost.aws/questions/QU7EmDfBcESiWaFTxZQKaAow/glue-py-shell-python-version

Answer

AWS Glue version 2.0 and above support python version 3.7.
https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

To use python version above 3.6, consider migrating your Glue job to version 2.0 or 3.0.
https://docs.aws.amazon.com/glue/latest/dg/migrating-version-30.html

Answer

Hello,

we recently added support for python 3.9 in Glue Python Shell scripts. With this release we also added more libraries out of the box and simplified how you can install additional libraries.

For more details please refer to [this blog post](https://aws.amazon.com/blogs/big-data/aws-glue-python-shell-now-supports-python-3-9-with-a-flexible-pre-loaded-environment-and-support-to-install-additional-libraries/).

hope this helps

AWS Glue python shell job is supporting only python 3.6, but boto3 is now stopping its support to python 3.6

関連するコンテンツ