Amazon S3 connectors. Pros and cons

Question

Hi Team,
I couldn't find list/details of the tools to which Amazon S3 integrates with by using a S3 connector. Which tools integrate with S3 to provide in-place querying of S3 data (i.e. data shouldn't move out from S3 in order to be queried).  How much data can be queried at a time? Does it support joins? What data formats can be queried ? Any pointers would really help. Thank you

Answer

[Amazon Athena](https://aws.amazon.com/athena/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc), is a distributed that will allow you to use SQL to query S3 data in place.

There are no pre-defined limit on size of data, yes it supports joins and you can [find supported data format here](https://docs.aws.amazon.com/athena/latest/ug/supported-serdes.html).

To understand how to create tables for Athena (only metadata, data is not moved) please refer to [this documentation page](https://docs.aws.amazon.com/athena/latest/ug/creating-tables.html).

For additional information you can look at the [FAQ](https://aws.amazon.com/athena/faqs/).

If you are already using Amazon Redshift it also can access data in place from S3, using [Amazon Redshift Spectrum](https://docs.aws.amazon.com/redshift/latest/dg/c-getting-started-using-spectrum.html).

Amazon S3 connectors. Pros and cons

Relevant questions

use Redshift Spectrum to query both Redshift table and s3 file

Cost of Access to Amazon S3 via Amazon CloudFront within an AWS Region

Can I use CloudFront to serve Amazon S3-Infrequent Access or Amazon S3 Glacier objects?

Can I use the RDS Postgresql S3 export query to replicate changes from RDS to S3?

Amazon S3 connectors. Pros and cons

How to integrate Amazon S3 into Microsoft Access

What will happen when API call to get a object from S3 which is in S3 infrequent storage or in Glacier ?

How to use multiple Lambdas to a single S3 used by amazon connect

Redshift Unload to S3 End of Line Encoding Type

Searching S3 objects