Keys in super columns in external table are lowercase

0

All of my keys in super fields in external tables became lowercase.

Current result is {"id": 1, "super_field": {"camelcase":1,"uppercase":2,"lowercase":3}}

Should be {"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}

My cluster updated to latest version 1.0.61559 . On the previous version 1.0.61191 everything works as expected.

Step to reproduce:

  1. Add jsonl file to s3:
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
{"id": 2, "super_field": {"camelCase": 5, "UPPERCASE": 6, "lowercase":7}}
  1. create external table
create
    external table test_external_db.test_table
    (
    id int,
    super_field super
    )
    ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
    WITH SERDEPROPERTIES ('ignore.malformed.json' = 'true')
    location 's3://';
  1. select * from test_external_db.test_table;
已提問 4 個月前檢視次數 153 次
1 個回答
0

Hi, not explaining why the behaviour has changed. But have you tried forcing not to convert case : WITH SERDEPROPERTIES ("case.insensitive"= FALSE;) ?

profile pictureAWS
Semir
已回答 4 個月前
  • Thanks for your answer. I tried it but it didn't help.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南