By using AWS re:Post, you agree to the Terms of Use

Glue PyShell Python Version

1

There was recently Glue 3.0 released which indicates newer Spark version and same Python version compared to Glue 2.0. Now as I understood Glue 2.0 updated only Spark type jobs but did not include anything for PyShell type jobs.

Does Glue 3.0. bring any updates for Glue PyShell? I.e. is PyShell still on python 3.6?

asked 6 months ago334 views
1 Answer
2
Accepted Answer

Hi ,

AWS Glue 3.0 updated only Spark type jobs (introduced support for Spark 3.1.1 and Scala 2.1.12).

UPDATE as of August 2022 AWS Glue Python Shell currently support python 3.9 and has introduced additional libraries out of the box, and simplified the installation of libraries that are not included in the base engine.

To learn more check this blog post.

hope this helps,

EXPERT
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions