MSCK REPAIR TABLE returns FAILED org.apache.hadoop.hive.ql.exec.DDLTask. nu

0

Hi,

I am trying to execute MSCK REPAIR TABLE but then it returns

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null

The query ID is 956b38ae-9f7e-4a4e-b0ac-eea63fd2e2e4

已提問 7 年前檢視次數 4491 次
5 個答案
0

Curious if you ever were able to get the root cause for this. We had the same problem (very intermittent).

Thanks
-Bill

已回答 6 年前
0

SET mapred.input.dir.recursive=true;
SET hive.mapred.supports.subdirectories=true;
ALTER TABLE table_name RECOVER PARTITIONS;

已回答 5 年前
0

I had same error, but resolved it to attach "s3:ListBucket" permission for underlying bucket on execution role. If you run the query from Lambda function or other AWS services, please try to add following policy on execution role. Athena needs to traverse folders to load partitions.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Action": [
                "s3:ListBucket"
            ],
            "Resource": "arn:aws:s3:::{YOUR_BUCKET_NAME}",
            "Effect": "Allow"
        }
    ]
}
已回答 5 年前
0

I had the same issue until I added permissions for action glue:BatchCreatePartition. Found that here https://aws.amazon.com/premiumsupport/knowledge-center/athena-aws-glue-msck-repair-table/

PlzHalp
已回答 4 年前
0

Hi BillMan2,

Did you ever get to the bottom of your issues? I am also getting this error intermittently.

Cheers
Ben

BenBMLL
已回答 4 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南