Athena/Iceberg: "Member must have length less than or equal to 1024"

0

When trying to insert data into an Athena/Iceberg table, using Java Athena JDBC Driver 3.0.0, getting error "Member must have length less than or equal to 1024".

The table:

			CREATE TABLE IF NOT EXISTS events (id STRING, event_timestamp_utc TIMESTAMP, event_type STRING, source STRING, source_timestamp TIMESTAMP, rawdata STRING,media STRING) 
			PARTITIONED BY (month(source_timestamp), bucket(10, id)) 
		        LOCATION 's3://" + bucket + "/athena-iceberg/' 
			TBLPROPERTIES ( 'table_type' ='ICEBERG', 'optimize_rewrite_data_file_threshold' = '49' )

The insert:

                            INSERT INTO events (id, event_timestamp_utc, event_type, source, source_timestamp, rawdata, media) VALUES (?, ?, ?, ?, ?, ?, ?)

Why does this limitation exist? Even SQLITE doesn't have such small arbitrary limits.

Is there a workaround?

Alex
질문됨 3달 전206회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠