Glue crawler creating a table only with 'Crawl all sub-folders' option, but not with 'Crawl new sub-folders only'

0

I have a .csv file in s3://<bucket-name>/SRC1/TBL1/2022/10/04/. Created a crawler on this bucket with the following configuration options

  • Crawl new sub-folders only
  • Create a single schema for each S3 path
  • Table level - 3
  • teaget data base 'sample-db'

When I trigger my crawler, expectation was to create a new table 'TBL1' in 'sample-db'. But it did not create the new table. Then I updated the config option to 'Crawl all sub-folders', then the table was created.

Question: Can we make crawler to create the table with option Crawl new sub-folders only TIA

已提问 2 年前85 查看次数
没有答案

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则