Questions tagged with Amazon QuickSight
Content language: English
Sort by most recent
Do filters in direct mode mean that the raw underlying SQL query is adding or modifying a where clause? OR does it sorta scan everything then filter it after the underlying data has been scanned?
I have multiple quicksight reports and analyses all using datasets that are cached in spice and from what I understand this means that all the queries are running off a cached disconnected dataset thats a copy of the actual underlying data and that copy is refreshed periodically. this works and its awesome.
I also have a timestream table thats large in the region of terabytes of data. This dataset is obviously too large to import into spice, which means I must directly query the dataset. I've imported the dataset and have set everything up, but when viewing data my timestream costs over the last few days have shot up immensely. I normally sit around 2-3 usd a day, and on the day I released my report it jumped to 90$.
If I look in the costing breakdown this is due to the amount of "Scanned bytes" in timestream.
All of my reports use filters to segment and breakdown the data but this obviously isn't working the way it should.
if my datasource is essentially "select * from table", and then i add a filter on the dataset does that mean the query sent to the datasource is "select * from table where column = filter" OR does it mean it loads all the rows and then does some other filtering after that? based off the speed of reports I assume its the first one, but if so then I need to figure out how to constrain the filters even more to load less data.
i have disabled the report for now and my timestream costs have once again dropped down to normal levels, and at this point i'm too scared to re-enable it, but people are clamoring for their data :/
Hello
I have JSON files for jobs created and extracted from Amazon transcribe and I need to add it to cloud formation stack of PCA
so I found that on my PCA(post call analytics) dashboard there is not option to create a new data source to add the JSON file to it
How can I add new data source (JSON files) from transcribe to PCA??
and How can I display my new jobs which created manually within transcribe on PCA as a data source?
Hi team, I just finished QS training and have a question regarding the runningsum function.
I know there’s a limitation of using it on top of sumover , can runningsum not be used on any LAC-A functions?
For example, the below calculation doesn’t give a subtotal value (while the distinct_count function works):
Calc - Dist: runningSum(
distinct_count({uid[wh_monthly_facts]}),
[{lifeline_months_tenure} ASC],
[{Approval_Month}]
)
https://docs.aws.amazon.com/quicksight/latest/user/level-aware-calculations.html
Hi all - We have a requirement where we need to send QuickSight Analysis or Dashboard via email ( business users). The business users are NOT part of QuickSight Group or access to QuickSight. All they need to have the statistics, graph and get the details via email. Is this possible in QuickSight.
Please advise.
Regards - Sanjeeb
Using the same example from: https://aws.amazon.com/blogs/big-data/add-comparative-and-cumulative-date-time-calculations-in-amazon-quicksight/
I am able to replicate both Quarter and Month Partial QoQ QTD Sales and MoM MT Sales:
PartialQoQQTDSales=periodOverPeriodPercentDifference(sumif(Sales, {Order Date} <= addDateTime(dateDiff(truncDate("Q", ${DateParameter}), ${DateParameter}, "DD"), "DD", truncDate("Q", {Order Date}))), {Order Date}, QUARTER, 1)
PartialMoMMTDSales=periodOverPeriodPercentDifference(sumif(Sales, {Order Date} <= addDateTime(dateDiff(truncDate("MM", ${DateParameter}), ${DateParameter}, "DD"), "DD", truncDate("Q", {Order Date}))), {Order Date}, QUARTER, 1)
However, Year to Date Partial YoY YTD Sales would not produce the desired result with:
PartialYoYYTDSales=periodOverPeriodPercentDifference(sumif(Sales, {Order Date} <= addDateTime(dateDiff(truncDate("YYYY", ${DateParameter}), ${DateParameter}, "DD"), "DD", truncDate("YYYY", {Order Date}))), {Order Date}, YEAR, 1)
any ideas what did I do wrong?
I want to create a real time data streaming dashboard on Quicksight using a 3rd Party API Endpoint. Can anyone suggest how to proceed ?
Hi there,
I have a map in my dashboard using postcodes and countries.
However, I can't cluster points (to make the map easier to digest for the viewer).
It says: 'Cluster points is not supported when using size field well'
What does this mean?
Thanks,
Axel
Hi Team,
I created an Athena table and used a quicksight dataset to connect to it. However, the quicksight page informed me that "The column(s) in this query are not found. Verify the column(s) specified in the dataset or in the custom SQL.". I checked the columns name from Athena and all looked good. What are the possible causes? Attached screenshot for your reference.
Below screenshots are from Athena 'recent queries', If I run it manually, it worked.
Successfully with manually running:
We store data in S3 hourly so that means 24 files per day * 30 days a month = 720 files a month but Quicksight has a 1000 file limit per manifest file when importing data from s3. What is the best practice here? Should I create a new manifest file each month and then combine the datasets into one?
Here is a link to the documentation: https://docs.aws.amazon.com/quicksight/latest/user/data-source-limits.html
When creating a new data set in QuickSight, I receive an error:
```
[Simba][AthenaJDBC](100071) An error has been thrown from the AWS Athena client. Access denied when writing to location: s3://<data lake bucket>/athena-workgroups/<data mart-specific prefix>/output/<guid>.csv [Execution ID: <guid>]
```
I have the QS service role--`arn:aws:iam::<account id>:role/service-role/aws-quicksight-service-role-v0`. I *do not* have a role with the name `aws-quicksight-s3-consumers-role-v0`.
That role has the 4 policies that are created when you attach Athena & an S3 bucket to QS:
* `AWSQuickSightIAMPolicy`
* `AWSQuickSightRDSPolicy`
* `AWSQuickSightRedshiftPolicy`
* `AWSQuickSightS3Policy`
`AWSQuickSightS3Policy` contains this:
```
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": "s3:ListAllMyBuckets",
"Resource": "arn:aws:s3:::*"
},
{
"Action": [
"s3:ListBucket"
],
"Effect": "Allow",
"Resource": [
"arn:aws:s3:::<data lake bucket>"
]
},
{
"Action": [
"s3:GetObject",
"s3:GetObjectVersion"
],
"Effect": "Allow",
"Resource": [
"arn:aws:s3:::<data lake bucket>/*"
]
},
{
"Action": [
"s3:ListBucketMultipartUploads",
"s3:GetBucketLocation"
],
"Effect": "Allow",
"Resource": [
"arn:aws:s3:::<data lake bucket>"
]
},
{
"Effect": "Allow",
"Action": [
"s3:PutObject",
"s3:AbortMultipartUpload",
"s3:ListMultipartUploadParts"
],
"Resource": [
"arn:aws:s3:::<data lake bucket>/*"
]
}
]
}
```
I've added the following policy/policies to the KMS key used on the data lake S3 bucket:
```
{
"Sid": "Allow access to data for Athena.",
"Effect": "Allow",
"Principal": {
"Service": "athena.amazonaws.com"
},
"Action": [
"kms:Decrypt",
"kms:Encrypt",
"kms:GenerateDataKey*"
],
"Resource": "*"
},
{
"Sid": "Allow access to data for QuickSight.",
"Effect": "Allow",
"Principal": {
"AWS": "arn:aws:iam::<account id>:role/service-role/aws-quicksight-service-role-v0"
},
"Action": [
"kms:Decrypt",
"kms:Encrypt",
"kms:GenerateDataKey*"
],
"Resource": "*"
},
{
"Sid": "Allow access to data for QuickSight.",
"Effect": "Allow",
"Principal": {
"Service": "quicksight.amazonaws.com"
},
"Action": [
"kms:Decrypt",
"kms:Encrypt",
"kms:GenerateDataKey*"
],
"Resource": "*"
}
```
I'm at a bit of a loss for how to continue. I've got what feels like wide open permissions, but I still receive that error while trying to create a data set that targets anywhere in that S3 bucket.
We require QuickSight dashboard usage and access data to analyze metrics on the dashboard itself and send out reports scheduled to send automatically via email.
Can anyone help us to get usage and access data from Quicksight and setup the dashboard usage and access summary?
I have a Quicksight Analysis that needs to be published as a Dashboard. The analysis is changing based on demands and I need to update and replace the contents of the existing dashboard. The only way that I know is to click the update and replace existing dashboard through the ui. Is there a way to automate this process?
Edit:
Follow up question. Ultimately what I wanted to do is to have the dashboard be refreshed alongside the refresh of the analysis (containing the refreshed dataset) without having to always run commands or click 'publish dashboard' in the ui. I'm looking for a way to trigger and automate that part. Thank you for your answers!