2개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
If I'm reading this sample correctly it should work; if so you'll have to stuff those libraries into a custom package and source it from there.
답변함 일 년 전
관련 콘텐츠
- AWS 공식업데이트됨 2년 전
- AWS 공식업데이트됨 일 년 전
- AWS 공식업데이트됨 2년 전
If I'm reading this sample correctly it should work; if so you'll have to stuff those libraries into a custom package and source it from there.
Thanks for your comment. Yes, The problem is not with PIP/Python packages. The problem is to use a Go app like SOPS. Which is used to decrypt secrets. In EMR we apply it using the bootstrap but in EMR Serverless there's no bootstrap available.
Interesting - are you shelling out to the Go binary from your Spark script? You can certainly include the binaries in the tarbell and it will get unpacked into an
environment
folder...I'm not sure if there's anything preventing you from executing other binaries, but you could give it a shot.