Glue Crawler , negative exclusion pattern

How can I apply a negative exclusion pattern on the configuration of my Crawler.

I would like to negate every folder that does not match the following

!prd**/queries/**

I want to exclude everything that does not match with this

Gonzalo Herreros ESPERTO
un anno fa
I don't think that's possible. What you do is multiple inputs to include each of those prd**/queries paths (maybe automating it with a small script)

Argomenti

Tag

Lingua

English

posta un anno fa277 visualizzazioni

1 Risposta

Queste risposte sono utili? Dai un voto positivo alla risposta corretta per aiutare la community a trarre vantaggio dalle tue conoscenze.

We cannot negate an exclusion pattern to exclude all folders except those that matches the pattern. Negate (!) is used within brackets [ ] as noted in the doc below - https://docs.aws.amazon.com/glue/latest/dg/define-crawler.html#crawler-data-stores-exclude

If there are too many folders, programmatically filtering and adding them in include path should help in this case.

con risposta un anno fa

Contenuto pertinente