2개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
1
The crawler doesn't do any conversion on the data, it registers what you have there.
So if you just have parquet files and not an Iceberg table, the crawler cannot do that. What the crawler can do is register an Iceberg table in S3 you already have.
Iceberg has utilities to create a table based on existing files, then you can ask the crawler to register it:
https://iceberg.apache.org/docs/latest/spark-procedures/#table-migration
0
Hello. Yes. Please look at this https://aws.amazon.com/about-aws/whats-new/2023/07/aws-glue-crawlers-apache-iceberg-tables/.
Regards, Andrii
관련 콘텐츠
- AWS 공식업데이트됨 3년 전
- AWS 공식업데이트됨 일 년 전
- AWS 공식업데이트됨 7달 전
- AWS 공식업데이트됨 2년 전
Notice the question says "some parquet files", there is no Iceberg table for the crawler to find