Simplest query failing randomly with "GENERIC_INTERNAL_ERROR: null"

Question

After lots of queries failed with "GENERIC_INTERNAL_ERROR: null", I reduced my query to a simplest   
SELECT * FROM table LIMIT 1;  
  
... and it is still failing randomly: **sometimes** it works, but most of the time it returns in less than 1 sec with that same "GENERIC_INTERNAL_ERROR: null".   
  
What is going on? The health dashboard says everything is OK!  
FWIW, an example Query Id: 15d47cfa-b757-4f0e-baa0-64c08b1e64a8

hwaves · Answer

this could be stale metadata issue.   
May be you can try to re-run the crawler to get the latest details.  
Sometimes also possible because of bad data/data type mismatch  
  
Edited by: hwaves on Jul 5, 2020 12:16 PM

hmijail · Answer

In case this helps anyone in the future, Customer Support found that this was caused by a bug in the OpenX JSON SerDe when trying to parse DECIMALs over 20 digits.  
  
Looks like the native Hive SerDe supports those, but anyway while waiting/troubleshooting I already got to the point of defining my tables with STRINGs instead of DECIMALs to get past any SerDe problem, and will probably just CAST on query if/when needed.

Simplest query failing randomly with "GENERIC_INTERNAL_ERROR: null"

Add your answer

Relevant content