Glue Crawler , negative exclusion pattern

How can I apply a negative exclusion pattern on the configuration of my Crawler.

I would like to negate every folder that does not match the following

!prd**/queries/**

I want to exclude everything that does not match with this

Gonzalo Herreros EXPERTO
hace un año
I don't think that's possible. What you do is multiple inputs to include each of those prd**/queries paths (maybe automating it with a small script)

Temas

Etiquetas

Idioma

English

preguntada hace un año277 visualizaciones

1 Respuesta

¿Son útiles estas respuestas? Vote a favor de la respuesta correcta para ayudar a la comunidad a beneficiarse de sus conocimientos.

We cannot negate an exclusion pattern to exclude all folders except those that matches the pattern. Negate (!) is used within brackets [ ] as noted in the doc below - https://docs.aws.amazon.com/glue/latest/dg/define-crawler.html#crawler-data-stores-exclude

If there are too many folders, programmatically filtering and adding them in include path should help in this case.

respondido hace un año

Contenido relevante