AWS Glue crawler

0

AWS Glue crawler is not pulling all tables names from s3 bucket. Files are present in S3 bucket, if there any setting we have to change for crawler so it pull all the tables from s3 bucket. Is there is know issue for glue crawler to pull data from s3 bucket.

질문됨 2년 전532회 조회
1개 답변
0

Hi,

how the Crawler is extracting the metadata from the files in the buckets depends on a few factors that you can review in this knowledge base article.

For example if the files are in subfolders/prefixes and are very similar they could be detected as partitions. More information can be found here.

To have more precise feedback for your specific situation could you please provide an example of the structure in S3 and the tables that are and are not created by the crawler?

Thank you, and hope this helps

AWS
전문가
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠