Keys in super columns in external table are lowercase

0

All of my keys in super fields in external tables became lowercase.

Current result is {"id": 1, "super_field": {"camelcase":1,"uppercase":2,"lowercase":3}}

Should be {"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}

My cluster updated to latest version 1.0.61559 . On the previous version 1.0.61191 everything works as expected.

Step to reproduce:

  1. Add jsonl file to s3:
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
{"id": 2, "super_field": {"camelCase": 5, "UPPERCASE": 6, "lowercase":7}}
  1. create external table
create
    external table test_external_db.test_table
    (
    id int,
    super_field super
    )
    ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
    WITH SERDEPROPERTIES ('ignore.malformed.json' = 'true')
    location 's3://';
  1. select * from test_external_db.test_table;
質問済み 4ヶ月前154ビュー
1回答
0

Hi, not explaining why the behaviour has changed. But have you tried forcing not to convert case : WITH SERDEPROPERTIES ("case.insensitive"= FALSE;) ?

profile pictureAWS
Semir
回答済み 4ヶ月前
  • Thanks for your answer. I tried it but it didn't help.

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン