- 最新
- 最多得票
- 最多評論
I'd suggest you to go through this re:Post Knowledge Center Article and this blog post.
Another thing to isolate this issue, I'd do is, add modules one by one and keep adding s3 path in the value field. This would help me to find which module is giving me the error.
Some of the modules, you can omit from this list as some of Python modules already provided in AWS Glue out of the box.
This would definitely help. Comment here if you have additional questions.
PS: It'd be helpful, if you can mention the source of wheel package, did you build it or was it directly downloaded and uploaded to s3. Are all the dependencies packaged in the mentioned package.
Abhishek
Hi, Unable to import module in aws glue jobeven after adding details in --additional-python-modules.
--additional-python-modules psycopg2-binary==2.8.6
Tried to specify .s3 path for whl file and tried. still mo luck
any can guide here ?
same issue
vivek, how do you fix --additional-python-modules psycopg2-binary==2.8.6? . i am in same boat.
thanks!, i has success, but now i have other problem,
im trying to connect with a api rest
and this its my code
i believe that its a some problem with a vpc, but for test i was open all ports inbound and outbound
It seems like you have enabled "required connection" in your glue job. Do "Edit job" and remove the required connection if you see one there already. With required connection it keeps the execution environment within your VPC and doesn't allow external connections. If this doesn't apply in your case then look at this re:Post Knowledge Center Article, this would definitely help you to pass this error. Comment here how it goes, happy to help further.
For me it turned out to be a network issue during installation (AWS services were reachable). I deployed the Glue Job into the wrong Subnet and I was therefore not able to connect to the NAT Gateways (Internet) and install pip modules (same would apply to your Security Group settings for the Job). Maybe this helps someone else too
Thanks for the response. yes my connection was not able to reach out to internet. I modified the NAT gateway and it worked
相關內容
- AWS 官方已更新 2 年前
- AWS 官方已更新 2 年前
- AWS 官方已更新 2 年前
in the log (I think output) there should be details about how pip is installing the modules and dependencies