CID dashboards not working?

0

I followed the documentation, deployed the provided CF stacks (single account) and set up the QuickSight access, but I don't seem to have any data appearing in S3 (and the QuickSight datasets aren't importing anything, and the dashboards show no data, which seems to follow). It's been a few months now since I originally set this up, but I'm circling back to it now and I don't see any obvious errors. I've gone back over the documentation and double checked everything, and it SEEMS to be OK, so I must be missing something. Probably something obvious.

RyanA
asked 3 months ago160 views
3 Answers
1
Accepted Answer

Hi RyanA - If you are seeing no CUR data in S3, perhaps there is an issue with the Cost and Usage Report setup. Please check https://catalog.workshops.aws/awscid/en-US/dashboards/foundational/cudos-cid-kpi/deploy for troubleshooting tips. You can also login to the console of the account, go to Billing console, then to Cost and Usage Reports to verify everything is setup correctly and S3 bucket destination matches the parameters used to setup CID. If all else fails, you could consider tearing down the deployment following instructions on this page and rebuild: https://catalog.workshops.aws/awscid/en-US/data-collection/teardown

AWS
answered 3 months ago
  • Ok thanks, this helped put me on the right track. I am now getting data in the bucket (the bucket policy needed fixing) but still nothing is importing into QuickSight despite it seemingly having access to the bucket under "QuickSight access to AWS services". Maybe another bucket policy issue, not sure, I'll be poking around.

0

RyanA - Once you resolved the bucket policy, the process might still take up to 24 hours to populate the data. Once the CUR files are populated in the S3 bucket, a Glue crawler will then create a database and table schema from those S3 files, which then will end up as Athena tables. The CID deployment will create a few specific Athena views to aggregate data from those tables which become the basis for the Quicksight dashboards. To troubleshoot further, I suggest logging into the Glue console to check for the Databases and Tables in the Glue Catalog, and do the same in the Athena table. If the tables exist in both places, then check in Quicksight Datasets. If the dataset configurations are there, you could initiate a manual dataset refresh in Quicksight for each dataset so that the Quicksight visuals will populate with data when complete.

AWS
answered 3 months ago
  • The tables appear to exist in Glue and Athena (cid_cur.*), but I don't seem to see any rows when I query any of them via Athena. I'm not yet sure why.

0

Hello RyanA,

As @rathmyle mentioned, the issue may lie with the setup of your CUR report in your Account. If you cannot see any data in the specified S3 bucket, then please verify your CUR report setup in your billing console. The data has to be generated in the S3 bucket which is mentioned in the CUR report configuration.

For more information on how to setup a CUR report, please refer to the below documentation,

[+]. https://docs.aws.amazon.com/cur/latest/userguide/cur-create.html

After you have setup the above CUR report and making sure the data is visible in the bucket, make sure you have enabled access to the CUR report S3 bucket in your Quicksight Account. After which you should be able to see the data/visual in the CID dashboard. We have a detailed workshop for this along with the necessary CF templates. Please go through the below link to access the workshop,

[+]. https://catalog.workshops.aws/awscid/en-US/dashboards/foundational/cudos-cid-kpi

I hope this was helpful in resolving your issue.

profile pictureAWS
SUPPORT ENGINEER
TejaG
answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions