Keys in super columns in external table are lowercase

0

All of my keys in super fields in external tables became lowercase.

Current result is {"id": 1, "super_field": {"camelcase":1,"uppercase":2,"lowercase":3}}

Should be {"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}

My cluster updated to latest version 1.0.61559 . On the previous version 1.0.61191 everything works as expected.

Step to reproduce:

  1. Add jsonl file to s3:
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
{"id": 2, "super_field": {"camelCase": 5, "UPPERCASE": 6, "lowercase":7}}
  1. create external table
create
    external table test_external_db.test_table
    (
    id int,
    super_field super
    )
    ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
    WITH SERDEPROPERTIES ('ignore.malformed.json' = 'true')
    location 's3://';
  1. select * from test_external_db.test_table;
已提问 4 个月前153 查看次数
1 回答
0

Hi, not explaining why the behaviour has changed. But have you tried forcing not to convert case : WITH SERDEPROPERTIES ("case.insensitive"= FALSE;) ?

profile pictureAWS
Semir
已回答 4 个月前
  • Thanks for your answer. I tried it but it didn't help.

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则