By using AWS re:Post, you agree to the Terms of Use

Delete partitions in Glue Data Catalog using crawler not working.


Hi, I have set up a crawler to run against an s3 bucket and set crawler configurations as follows:

Schema updates in the data store: Ignore the change and don't update the table in the data catalog, Inherit schema from table: Update all new and existing partitions with metadata from the table, Object deletion in the data store: Delete tables and partitions from the data catalog

Updation of partition is taking place but deletion of partitions from catalog for the partitions deleted from s3 bucket is not taking place. It is not throwing any errors as well.

asked 4 months ago36 views