For a DeltaTarget, glue.create_crawler is not recognizing the parameter "CreateNativeDeltaTable"

0

Unknown parameter in Targets.DeltaTargets[0]: "CreateNativeDeltaTable", must be one of: DeltaTables, ConnectionName, WriteManifest.

However, in the documentation it shows the parameter (see DeltaTarget): boto3 docs

import boto3

glue = boto3.client('glue')

glue.create_crawler(
  Name='mycrawler',
  Role='myrole', 
  DatabaseName='mydb',
  Targets={
    'DeltaTargets': [
        {
            'DeltaTables': [
                's3://my/delta/table/location',
            ],
            'ConnectionName': '',
	    'WriteManifest': False,
	    'CreateNativeDeltaTable': True,
        }
    ]
  },
  SchemaChangePolicy={
    'UpdateBehavior': 'LOG',
    'DeleteBehavior': 'LOG'
  }
)


temp999
已提問 4 個月前檢視次數 160 次
1 個回答
1
已接受的答案

Hi,

This issue generally happens with the boto3 version. I tested this on my end and was facing the same issue as yours. Please use the latest boto3 version to resolve this issue. I used the 1.28.69 version and it works fine. Please pass the below parameter in "Job parameters" tab under job details to use the latest boto3 version.

Key: --additional-python-modules
Value: boto3==1.28.69

Thank you.

AWS
支援工程師
已回答 4 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南