Glue table recreation causes GENERIC_INTERNAL_ERROR: io.trino.spi.block.VariableWidthBlockBuilder

1

It seems like there is an issue with the management of glue tables under the hood?

We have data pipelines that have recently started failing on all our raw glue tables, where downstream tables started getting "GENERIC_INTERNAL_ERROR" messages. On recreation of the source glue table, when reloading partitions for the raw source glue table and querying the data we now receive "GENERIC_INTERNAL_ERROR: io.trino.spi.block.VariableWidthBlockBuilder", has something changed with regards to glue or athena recently? All table updates are failing that are dependant on these raw glue tables.

Furthermore, if I create the same table under a different table name with the same configurations (partitions, schemas, serializers, format), the table is functional and I can query the data

Additional information:

Input format org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat Output format org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat Serde serialization lib org.apache.hadoop.hive.serde2.avro.AvroSerDe

Tasso
질문됨 10달 전300회 조회
1개 답변
0

Can confirm. Started happening starting from 2023/09/14. Running create or replace view statemen against Glue tables. Among 80 tables, around 10 statements are failing. And source tables on those 10 are random.

For the same operation based on other views the error is a bit different: Error: line 7:23: Failed analyzing stored view '092448557875.schema_name.view_name': GENERIC_INTERNAL_ERROR

Artem
답변함 10달 전
  • Same here.. I spent all day figuring this out.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠