AWS S3 Tables and DBeaver Community Edition

0

We use Dbeaver (Community Edition) as our main query tool and we would like to know how to integrate it with the new S3 Tables. Eventhough using the latest Athena JDBC driver (3.5.0), we can not see the catalogs other than AwsDataCatalog in a treeview windows, but we can run sql scripts like SELECT * FROM "s3tablescatalog/<table-bucket>"."<namespace>"."<table>" limit 10;

asked a month ago55 views
2 Answers
0

While DBeaver Community Edition can connect to Amazon Athena, it currently has limitations when working with S3 Tables. The issue you're experiencing with not being able to see catalogs other than AwsDataCatalog in the treeview is a known limitation.

However, as you've discovered, you can still query S3 Tables using SQL scripts directly. This is because S3 Tables use a separate catalog from the default AWS Glue Data Catalog, which is why you need to specify the full path including the s3tablescatalog in your queries.

To work with S3 Tables in DBeaver:

  1. Ensure you're using the latest Athena JDBC driver, which you've already done.

  2. Connect to Athena as you normally would in DBeaver.

  3. Instead of relying on the treeview, you'll need to write your queries manually, specifying the full path to your S3 Tables. For example:

    SELECT * FROM "s3tablescatalog/<table-bucket>"."<namespace>"."<table>" LIMIT 10;

  4. You can create SQL scripts in DBeaver with these queries to work with your S3 Tables.

  5. Remember to use the correct catalog name (s3tablescatalog/<your-bucket-name>), namespace, and table name in your queries.

While this method requires more manual input compared to using the treeview, it allows you to continue using DBeaver with S3 Tables. Keep in mind that as S3 Tables is a relatively new feature, tool support may improve in future updates to DBeaver or the Athena JDBC driver.

For a more integrated experience, you might consider using other AWS-provided tools like the Athena console or Amazon SageMaker Unified Studio, which have better native support for S3 Tables. However, if DBeaver is your preferred tool, the manual query method should allow you to work with S3 Tables effectively.
Sources
Querying Amazon S3 tables with Athena - Amazon Simple Storage Service
S3 Tables - Unable to query using Athena | AWS re:Post
Amazon S3 tables integration - Amazon SageMaker Unified Studio

profile picture
answered a month ago
0

Just to help others. One way to get S3 Tables to be seen on Dbeaver is using Lakeformation´s resource link. Works like a charm and serves like a workaround

answered 7 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions