Load S3 Bucket data into Aurora PostgreSQL tables

Question

I need to load my data from S3 Bucket into the Aurora PostgreSQL tables. I read https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_PostgreSQL.S3Import.html#USER_PostgreSQL.S3Import.Reference this documentation and I will try. But, do we have any other way to be able to handle this case?

Especially I want to ask, Is there any LOAD command which exists on Aurora PostgreSQL?

Thanks!

Especially I want to ask, Is there any LOAD command which exists on Aurora PostgreSQL?

Thanks!

Indranil Banerjee AWS · Answer

One option could be to use DMS.

DMS does support S3 as a source - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.S3.html

DMS supports Aurora Postgres as a target - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.PostgreSQL.html

AWS-User-0081273 · Answer

The procedure for using the table_import_from_s3() function is explained here: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_PostgreSQL.S3Import.html

You call the function from a SELECT statement. And so you could automate that by calling psql from a shell script, and passing the SELECT statement as a -c (command) or -f (SQL script file) argument to psql.

Load S3 Bucket data into Aurora PostgreSQL tables

Add your answer

Relevant content