Data collection for dashboards
I tried to install the stacks for enable Trusted Advisor dashboard. I deployed the stacks in management accounts and also in dta collection account.
in data collection account i can see the two state function are succeeded. but can see the tables in the athena. How to fix
- Topics
- Management & Governance
- Language
- English
asked a year ago176 views
- Newest
- Most votes
- Most comments
It sounds like you've successfully deployed the stacks for the Trusted Advisor dashboard in both your management and data collection accounts, and the state functions are running successfully in the data collection account. However, you're not seeing the expected tables in Athena. This can happen for a few reasons:
-
Data processing delay: There might be a delay between when the state functions run and when the data becomes available in Athena. It can take up to 24-48 hours for the initial data to appear.
-
Glue crawler issues: The AWS Glue crawler responsible for creating and updating the Athena tables may not be running correctly. Check the Glue console to ensure the crawler is scheduled and running without errors.
-
S3 data issues: Verify that the data is being correctly written to the S3 bucket in the data collection account. The Trusted Advisor data should be in a specific folder structure.
-
IAM permissions: Ensure that your IAM role has the necessary permissions to view the tables in Athena.
To troubleshoot and fix this issue:
-
Wait for 24-48 hours to see if the tables appear, as there might be a delay in initial data processing.
-
Check the AWS Glue console to ensure the crawler for Trusted Advisor data is running successfully. Look for any error messages in the crawler logs.
-
Verify the S3 bucket in your data collection account to ensure the Trusted Advisor data is being written correctly.
-
Review the IAM permissions for your role to make sure you have access to view the tables in Athena.
-
If the issue persists, you may need to manually run the Glue crawler or recreate it to ensure it's properly cataloging the data for Athena.
-
As a last resort, you might need to redeploy the data collection stack to ensure all components are correctly set up.
If these steps don't resolve the issue, you may need to engage AWS support for further assistance, as there could be specific configuration details in your environment that require more in-depth troubleshooting.
Sources
Trusted Advisor Organisational Cloud Intelligence Dashboards | AWS re:Post
focus table (AWS Glue) used by Focus Dashboard has no data from source accounts | AWS re:Post
