How can I import exported snapshot to s3 from Aurora PostgreSQL or how can query apache parquet from s3?

Question

I need to store snapshots exported from Aurora PostgreSQL in S3 for a long period due to compliance and I need to know if there is any way to import these gzip Apache Parquet files into a new Aurora PostgreSQL or how I could make a query using perhaps Athena and Glue in the file to access the information contained in the tables.

Riku_Kobayashi · Answer

Hello.

You can export snapshots to S3 using the steps in the following document:  
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-export-snapshot.Exporting.html

By the way, it is also possible to export to S3 directly from the Aurora cluster instead of from a snapshot.  
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/postgresql-s3-export.html

Since the data is exported to S3 in Parquet format, you can create a table in Athena and view it.  
The following blog post uses Aurora MySQL for the operations, but similar operations are performed on Aurora PostgreSQL, so it may be useful as a reference.  
https://www.sqlshack.com/export-amazon-aurora-mysql-or-amazon-rds-snapshots-to-aws-s3-buckets/

How can I import exported snapshot to s3 from Aurora PostgreSQL or how can query apache parquet from s3?

Add your answer

Relevant content