By using AWS re:Post, you agree to the AWS re:Post Terms of Use

Import CSV file in S3 into Aurora MySql

0

I'm trying to import a CSV file from S3 into my Aurora for MySql table. Amazon Docs shows this can be done using LOAD DATA FROM S3.

However, MySQL Workbench is marking this as an error and failing. It says "S3" is not valid at this position, expecting \M\A\S\T\E\R.

I don't see a way to run the command directly on Aurora without the workbench. How can I get this to work?

I'm using MySQL Workbench 8.0.36, and a provisioned cluster running 8.0.mysql_aurora.3.04.1. As far as I can tell, I have configured permissions correctly (though the problem does not seem to be permissions related. I also have no problem running queries on my cluster from the workbench.

profile picture
asked 10 months ago768 views
1 Answer
1
Accepted Answer

Hello.

Have you set an IAM role for Aurora MySQL?
If you have not set it, please set it by following the steps in the document below.
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Integrating.LoadFromS3.html#AuroraMySQL.Integrating.LoadFromS3.Authorize

Also, what command did you run?
To read the text, you need to specify the S3 URL as shown below.

LOAD DATA FROM S3 's3://mybucket/data.txt'
    INTO TABLE table1
    (column1, @var1)
    SET table_column2 = @var1/100;

To connect to Aurora MySQL without using "Workbench" you need to use MySQL commands.
You need to run the below command below.

mysql -h "Aurora MySQL Endpoint" -u root -p
profile picture
EXPERT
answered 10 months ago
profile picture
EXPERT
reviewed 6 months ago
profile picture
EXPERT
reviewed 8 months ago
  • I did set the IAM role, and use the command with the S3 URL as in the example. Workbench appears to complain about the S3 part of the command, before even reaching the URL.

    mysql command works - thank you. It sure would have been nice to be able to run this from the workbench.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions