MSCK REPAIR TABLE returns FAILED org.apache.hadoop.hive.ql.exec.DDLTask. nu

0

Hi,

I am trying to execute MSCK REPAIR TABLE but then it returns

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null

The query ID is 956b38ae-9f7e-4a4e-b0ac-eea63fd2e2e4

질문됨 7년 전4493회 조회
5개 답변
0

Curious if you ever were able to get the root cause for this. We had the same problem (very intermittent).

Thanks
-Bill

답변함 6년 전
0

SET mapred.input.dir.recursive=true;
SET hive.mapred.supports.subdirectories=true;
ALTER TABLE table_name RECOVER PARTITIONS;

답변함 5년 전
0

I had same error, but resolved it to attach "s3:ListBucket" permission for underlying bucket on execution role. If you run the query from Lambda function or other AWS services, please try to add following policy on execution role. Athena needs to traverse folders to load partitions.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Action": [
                "s3:ListBucket"
            ],
            "Resource": "arn:aws:s3:::{YOUR_BUCKET_NAME}",
            "Effect": "Allow"
        }
    ]
}
답변함 5년 전
0

I had the same issue until I added permissions for action glue:BatchCreatePartition. Found that here https://aws.amazon.com/premiumsupport/knowledge-center/athena-aws-glue-msck-repair-table/

PlzHalp
답변함 4년 전
0

Hi BillMan2,

Did you ever get to the bottom of your issues? I am also getting this error intermittently.

Cheers
Ben

BenBMLL
답변함 4년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인