Amazon S3 connectors. Pros and cons
Hi Team, I couldn't find list/details of the tools to which Amazon S3 integrates with by using a S3 connector. Which tools integrate with S3 to provide in-place querying of S3 data (i.e. data shouldn't move out from S3 in order to be queried). How much data can be queried at a time? Does it support joins? What data formats can be queried ? Any pointers would really help. Thank you
Amazon Athena, is a distributed that will allow you to use SQL to query S3 data in place.
There are no pre-defined limit on size of data, yes it supports joins and you can find supported data format here.
To understand how to create tables for Athena (only metadata, data is not moved) please refer to this documentation page.
For additional information you can look at the FAQ.
If you are already using Amazon Redshift it also can access data in place from S3, using Amazon Redshift Spectrum.
Thanks Fabrizio. Sorry, I should have mentioned that we are looking at tools other than Athena/Redshift to which S3 can connect using connectors. We are already using Athena/Redshift. Where can I get more information on S3 connectors? Please guide
use Redshift Spectrum to query both Redshift table and s3 fileAccepted Answerasked 2 years ago
Cost of Access to Amazon S3 via Amazon CloudFront within an AWS RegionAccepted Answerasked 2 years ago
Can I use CloudFront to serve Amazon S3-Infrequent Access or Amazon S3 Glacier objects?Accepted Answerasked 2 years ago
Can I use the RDS Postgresql S3 export query to replicate changes from RDS to S3?Accepted Answerasked a year ago
Amazon S3 connectors. Pros and consasked 4 months ago
How to integrate Amazon S3 into Microsoft Accessasked 4 months ago
What will happen when API call to get a object from S3 which is in S3 infrequent storage or in Glacier ?asked 4 months ago
How to use multiple Lambdas to a single S3 used by amazon connectasked 6 months ago
Redshift Unload to S3 End of Line Encoding Typeasked 3 months ago
Searching S3 objectsAccepted Answerasked a year ago