MSCK REPAIR TABLE returns FAILED org.apache.hadoop.hive.ql.exec.DDLTask. nu

0

Hi,

I am trying to execute MSCK REPAIR TABLE but then it returns

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null

The query ID is 956b38ae-9f7e-4a4e-b0ac-eea63fd2e2e4

質問済み 7年前4492ビュー
5回答
0

Curious if you ever were able to get the root cause for this. We had the same problem (very intermittent).

Thanks
-Bill

回答済み 6年前
0

SET mapred.input.dir.recursive=true;
SET hive.mapred.supports.subdirectories=true;
ALTER TABLE table_name RECOVER PARTITIONS;

回答済み 5年前
0

I had same error, but resolved it to attach "s3:ListBucket" permission for underlying bucket on execution role. If you run the query from Lambda function or other AWS services, please try to add following policy on execution role. Athena needs to traverse folders to load partitions.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Action": [
                "s3:ListBucket"
            ],
            "Resource": "arn:aws:s3:::{YOUR_BUCKET_NAME}",
            "Effect": "Allow"
        }
    ]
}
回答済み 5年前
0

I had the same issue until I added permissions for action glue:BatchCreatePartition. Found that here https://aws.amazon.com/premiumsupport/knowledge-center/athena-aws-glue-msck-repair-table/

PlzHalp
回答済み 4年前
0

Hi BillMan2,

Did you ever get to the bottom of your issues? I am also getting this error intermittently.

Cheers
Ben

BenBMLL
回答済み 4年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ