Receiving EntityNotFoundException error intermittently

0

Hello everyone, We have been receiving this EntityNotFoundException error intermittently for one of our lambda fuctions. We've found that the EntityNotFoundException error we've been getting is actually a result of the GLUE job not being processed properly, which is why it's failing. By looking at the logs, We can see that the GLUE job is having issue in creating new table after deleting the old one which is why the lambda function is not able to locate it. We need guidance on why the error is occuring as there have been no code changes from our side.

Error Details: [ERROR] EntityNotFoundException: An error occurred (EntityNotFoundException) when calling the GetTable operation: Table tbl_site_crowdflower not found. Traceback (most recent call last):   File "/var/task/lambda_function.py", line 104, in lambda_handler     create_generic_db(data,bus_date,src_bucket_name)   File "/var/task/lambda_function.py", line 146, in create_generic_db     res = glue.get_table(DatabaseName=backup_databasename, Name=tbl_name)   File "/var/runtime/botocore/client.py", line 391, in _api_call     return self._make_api_call(operation_name, kwargs)   File "/var/runtime/botocore/client.py", line 719, in _make_api_call     raise error_class(parsed_response, operation_name)

EntityNotFoundException

  • Are you creating and deleting the same table? I wonder if it's a timing issue.

질문됨 일 년 전214회 조회
1개 답변
0

Hello,

Based on the error message:

EntityNotFoundException: An error occurred (EntityNotFoundException) when calling the GetTable operation: Table tbl_site_crowdflower not found.

Looking into the stack trace, the exception was triggerred by this lineres = glue.get_table(DatabaseName=backup_databasename, Name=tbl_name) , which is a Glue get_table API call via boto3.

The exception indicates your boto3 client cannot find table "tbl_site_crowdflower". Such an issue can be caused by various reasons, please double check and make sure:

  1. The specific table exists under the database and the region.
  2. If your account has enabled Lake Formation permission control, check if the IAM role has sufficient Lake Formation permissions to list the database and the table.

I hope this helps resolve the issue. Have a nice day!

Ref: https://docs.aws.amazon.com/lake-formation/latest/dg/lf-permissions-reference.html https://docs.aws.amazon.com/lake-formation/latest/dg/granting-catalog-permissions.html

AWS
Ethan_H
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠