Keys in super columns in external table are lowercase

0

All of my keys in super fields in external tables became lowercase.

Current result is {"id": 1, "super_field": {"camelcase":1,"uppercase":2,"lowercase":3}}

Should be {"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}

My cluster updated to latest version 1.0.61559 . On the previous version 1.0.61191 everything works as expected.

Step to reproduce:

  1. Add jsonl file to s3:
{"id": 1, "super_field": {"camelCase": 1, "UPPERCASE": 2, "lowercase":3}}
{"id": 2, "super_field": {"camelCase": 5, "UPPERCASE": 6, "lowercase":7}}
  1. create external table
create
    external table test_external_db.test_table
    (
    id int,
    super_field super
    )
    ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe'
    WITH SERDEPROPERTIES ('ignore.malformed.json' = 'true')
    location 's3://';
  1. select * from test_external_db.test_table;
posta 4 mesi fa154 visualizzazioni
1 Risposta
0

Hi, not explaining why the behaviour has changed. But have you tried forcing not to convert case : WITH SERDEPROPERTIES ("case.insensitive"= FALSE;) ?

profile pictureAWS
Semir
con risposta 4 mesi fa
  • Thanks for your answer. I tried it but it didn't help.

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande