The exclude pattern could be of special help here:
try using the
version*/_temporary** as the exclude pattern.
This would exclude all the unwanted files other than the parquet files.
For the include pattern, use
you would not need to provide a level for this case.
Check "Create single schema for each S3 path"
This would create one table with "version*" as partitions.
Set correct Table level, Include Path and Exclude path.Accepted Answer
S3 file path descriptionAccepted Answerasked 3 years ago
"Grouping Behavior for S3 Data" on Crawler does not work.
CloudFront Origin PathAccepted Answerasked 9 months ago
bulk move files from root of an S3 bucket to a folder (but not include other folders)Accepted Answerasked 9 months ago
S3 replication path customisedasked 2 months ago
What should be the correct Exclude Pattern and Table level when dealing with folders with different names?Accepted Answer
Is there a way to pull a list of users who have access to each folder and file under a parent folder?asked 3 months ago
Unable to have # character in Path for RedirectConfigasked 4 months ago
Glue Crawler error: Folder partition keys do not match table partition keysasked 7 months ago