Glue Crawler , negative exclusion pattern

How can I apply a negative exclusion pattern on the configuration of my Crawler.

I would like to negate every folder that does not match the following

!prd**/queries/**

I want to exclude everything that does not match with this

Gonzalo Herreros ESPECIALISTA
há um ano
I don't think that's possible. What you do is multiple inputs to include each of those prd**/queries paths (maybe automating it with a small script)

Tópicos

Tags

Idioma

English

feita há um ano277 visualizações

1 Resposta

Essas respostas são úteis? Vote a favor da resposta correta para ajudar a comunidade a se beneficiar de seu conhecimento.

We cannot negate an exclusion pattern to exclude all folders except those that matches the pattern. Negate (!) is used within brackets [ ] as noted in the doc below - https://docs.aws.amazon.com/glue/latest/dg/define-crawler.html#crawler-data-stores-exclude

If there are too many folders, programmatically filtering and adding them in include path should help in this case.

respondido há um ano

Conteúdo relevante