Which database in AWS should I use to upload data for QuickSight?

Question

I have wrote a python script that extracts AWS Batch jobs data and corresponding logs from CloudWatch. I want to use these information to create a dashboard on Amazon QuickSight. I am going to write a lambda function that gets triggered every 6 hours and update the database. Whenever there is an update on the database, I want the data on QuickSight to be updated as well, like direct query mode in SQL. I am thinking about using DynamoDB or RDS. Which one would be better?

Accepted Answer

Based on the scenario you have, I will recommend using Athena. Athena is a serverless interactive query service. You can store the data in S3, and Athena is designed to query data stored in S3. This will be the cost-effective solution for your use case. Additionally, Athena integrates seamlessly with Amazon QuickSight, allowing you to easily connect your data source and create visualization dashboards.

> Store data in S3 --> Create Athena Table  --> Trigger Lambda function --> Connect Athena to Quicksight

This blog is not a direct solution however it cover the usecase you shared - 
https://aws.amazon.com/blogs/big-data/power-operational-insights-with-amazon-quicksight/

Which database in AWS should I use to upload data for QuickSight?

Relevant content