Athena queries against mongodb

0

Hi,

I believe one can run Athena queries against a MongoDB instance using the DocumentDb connector. I've setup a connection and Athena able to read the collections within my database.

When trying to run any query, I get an error like the one below. This happens even when I use the "Preview Table" query. One thing I noticed straight away in the error message is that, even though I type my collection name with a starting capital letter (e.g. User) in my query, it's getting reported back in the error in all lowercase (e.g. "user").

My example table name

User

Here is a sample query (fake db and collection names used):

SELECT * FROM "mydb"."User" limit 10;

Here is an example error message:

NOT_SUPPORTED: Table has no columns: mongo_db:LambdaTableHandle{tableName=TableName{schemaName=mydb, tableName=user}}
This query ran against the "xxx" database, unless qualified by the query.

My first guess, based on the above error, is that Athena is lowercasing the collection name, and in so doing, not finding the correct collection.

Does anyone know:

  • If this is the case - i.e. that table names are lowercased?
  • If there are settings to change this - i.e. not to lowercase the table name?
  • If there is anything I can try

I'd appreciate any help or guidance!

Thanks!

posta 2 anni fa257 visualizzazioni
1 Risposta
0

It was a known BUG in documentDB connector, it can be resolved by setting the following value in your ENV variables. set disable_projection_and_casing to true

Find the reported bug which now has been resolved. https://github.com/awslabs/aws-athena-query-federation/issues/463

AWS
con risposta 10 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande