Amazon S3 connectors. Pros and cons

Question

Hi Team,
I couldn't find list/details of the tools to which Amazon S3 integrates with by using a S3 connector. Which tools integrate with S3 to provide in-place querying of S3 data (i.e. data shouldn't move out from S3 in order to be queried).  How much data can be queried at a time? Does it support joins? What data formats can be queried ? Any pointers would really help. Thank you

Answer

[Amazon Athena](https://aws.amazon.com/athena/?whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc), is a distributed that will allow you to use SQL to query S3 data in place.

There are no pre-defined limit on size of data, yes it supports joins and you can [find supported data format here](https://docs.aws.amazon.com/athena/latest/ug/supported-serdes.html).

To understand how to create tables for Athena (only metadata, data is not moved) please refer to [this documentation page](https://docs.aws.amazon.com/athena/latest/ug/creating-tables.html).

For additional information you can look at the [FAQ](https://aws.amazon.com/athena/faqs/).

If you are already using Amazon Redshift it also can access data in place from S3, using [Amazon Redshift Spectrum](https://docs.aws.amazon.com/redshift/latest/dg/c-getting-started-using-spectrum.html).

Amazon S3 connectors. Pros and cons

관련 콘텐츠