1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
The exclude pattern could be of special help here:
try using the version*/_temporary**
as the exclude pattern.
This would exclude all the unwanted files other than the parquet files.
For the include pattern, use s3://a/b/c/products/'
you would not need to provide a level for this case.
Check "Create single schema for each S3 path"
This would create one table with "version*" as partitions.
Reference: https://docs.aws.amazon.com/glue/latest/dg/crawler-s3-folder-table-partition.html
beantwortet vor 2 Jahren
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 3 Jahren
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr