All of my keys in super fields in external tables became lowercase.
Current result is
{"id": 1, "super_field": {"camelcase":1,"uppercase":2,"lowercase":3}}
Should be
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
My cluster updated to latest version 1.0.61559 . On the previous version 1.0.61191 everything works as expected.
Step to reproduce:
- Add jsonl file to s3:
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
{"id": 2, "super_field": {"camelCase": 5, "UPPERCASE": 6, "lowercase":7}}
- create external table
create
external table test_external_db.test_table
(
id int,
super_field super
)
ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
WITH SERDEPROPERTIES ('ignore.malformed.json' = 'true')
location 's3://';
select * from test_external_db.test_table;
Thanks for your answer. I tried it but it didn't help.