For a DeltaTarget, glue.create_crawler is not recognizing the parameter "CreateNativeDeltaTable"

0

Unknown parameter in Targets.DeltaTargets[0]: "CreateNativeDeltaTable", must be one of: DeltaTables, ConnectionName, WriteManifest.

However, in the documentation it shows the parameter (see DeltaTarget): boto3 docs

import boto3

glue = boto3.client('glue')

glue.create_crawler(
  Name='mycrawler',
  Role='myrole', 
  DatabaseName='mydb',
  Targets={
    'DeltaTargets': [
        {
            'DeltaTables': [
                's3://my/delta/table/location',
            ],
            'ConnectionName': '',
	    'WriteManifest': False,
	    'CreateNativeDeltaTable': True,
        }
    ]
  },
  SchemaChangePolicy={
    'UpdateBehavior': 'LOG',
    'DeleteBehavior': 'LOG'
  }
)


temp999
asked 4 months ago149 views
1 Answer
1
Accepted Answer

Hi,

This issue generally happens with the boto3 version. I tested this on my end and was facing the same issue as yours. Please use the latest boto3 version to resolve this issue. I used the 1.28.69 version and it works fine. Please pass the below parameter in "Job parameters" tab under job details to use the latest boto3 version.

Key: --additional-python-modules
Value: boto3==1.28.69

Thank you.

AWS
SUPPORT ENGINEER
answered 4 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions