CONSTRAINT_VIOLATION: Query exceeded maximum columns or filters.

Question

Hi All  
I have encountered a new error after the athena upgrade to V2. this error only happens when we load a columnar file (csv) that contains more than 200+ columns.  
the error message is:  
```CONSTRAINT_VIOLATION: Query exceeded maximum columns or filters. Please reduce the number of columns and filters referenced and re-run the query. If a data manifest file was generated at 's3:///athenaqueries/-manifest.csv', you may need to manually clean the data from locations specified in the manifest. Athena will not delete data in your account.  
  
This query ran against the "" database, unless qualified by the query. Please post the error message on our forum or contact customer support .....```   
  
We have roll the engine version back to version 1 and it worked, its a pretty large breaking change, limiting column counts (and its not in release notes). does anyone know why v2 limit the column counts and what's the solution?  
  
Regards  
HZ  
  
Edited by: hz-DCS on Jun 14, 2021 7:47 PM

AWS-User-0247734 · Answer

Any update?  
  
I too have received the same error message.  In my case, I have only 1 column-- so I know the problem is likely not the number of columns. That said, seems to me that  the error message is misleading.    
  
The failing queries have a modest number of FILTER calls ( <= 20) but a large number of CONTAINS, 1050.

CONSTRAINT_VIOLATION: Query exceeded maximum columns or filters.

Add your answer

Relevant content