Import CSV file in S3 into Aurora MySql

0

I'm trying to import a CSV file from S3 into my Aurora for MySql table. Amazon Docs shows this can be done using LOAD DATA FROM S3.

However, MySQL Workbench is marking this as an error and failing. It says "S3" is not valid at this position, expecting \M\A\S\T\E\R.

I don't see a way to run the command directly on Aurora without the workbench. How can I get this to work?

I'm using MySQL Workbench 8.0.36, and a provisioned cluster running 8.0.mysql_aurora.3.04.1. As far as I can tell, I have configured permissions correctly (though the problem does not seem to be permissions related. I also have no problem running queries on my cluster from the workbench.

profile picture
已提问 3 个月前302 查看次数
1 回答
0
已接受的回答

Hello.

Have you set an IAM role for Aurora MySQL?
If you have not set it, please set it by following the steps in the document below.
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Integrating.LoadFromS3.html#AuroraMySQL.Integrating.LoadFromS3.Authorize

Also, what command did you run?
To read the text, you need to specify the S3 URL as shown below.

LOAD DATA FROM S3 's3://mybucket/data.txt'
    INTO TABLE table1
    (column1, @var1)
    SET table_column2 = @var1/100;

To connect to Aurora MySQL without using "Workbench" you need to use MySQL commands.
You need to run the below command below.

mysql -h "Aurora MySQL Endpoint" -u root -p
profile picture
专家
已回答 3 个月前
profile picture
专家
已审核 1 个月前
  • I did set the IAM role, and use the command with the S3 URL as in the example. Workbench appears to complain about the S3 part of the command, before even reaching the URL.

    mysql command works - thank you. It sure would have been nice to be able to run this from the workbench.

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则