All Content tagged with Analytics

I was trying to upgrade the version of Apache Airflow from 2.2.2 to 2.10.2 but I was getting the error with installing the packages in the requirement.txt file in dbt-redshift , dbt-postgres , dbt-cor...

I have a kinesis stream with very low volume (30 small JSON messages each hour) and connected to that, a Firehose instance which is reading from the stream and storing the JSON objects to an S3 bucket...

I am encountering an IllegalArgumentException while running a PII detection script in AWS Glue. The error message indicates that an invalid column name is being used in sourceColumns. ``` S3bucket_n...

Hello everyone, I’m trying to create a histogram in AWS QuickSight to display my IoT data. However, every time I attempt to create a visualization, I only get options with aggregate functions (like a...

Hi community, I need to store hourly and daily data for about 6,000 assets in my PostgreSQL Aurora DB. Given the scale, I plan to keep three years of daily data and three months of hourly data. Addit...

Under AWS Glue > Data Catalog > Connections > Create connection, a JDBC connection is created. Would like to test the connection, however, no IAM role is available for selection to proceed with the te...

Hi there, Im reaching out with a query about Security Hub Thing is, Im a beginner with Security Hub and our company recently started the project for deploying & tracking the Security findings throug...

Getting this error when try to start an Athena query using Python: "Error details TABLE_NOT_FOUND: line 5:11: Table 'awsdatacatalog.athenacurcfn_c_u_r_athena.cur_athena' does not exist This query ran...

Trying to have a Glue Crawler/Athena automatically pick up a timestamp format of `yyyy-MM-dd'T'HH:mm:ss.SSS'Z'`. I have confirmed all the values in my dataset are formatted as this format, example: ...

Came across the following useful documentation: https://docs.aws.amazon.com/prescriptive-guidance/latest/apache-iceberg-on-aws/best-practices-read.html#read-sort-order I have a large table where I pl...

We have loved the flexibility of the Athena engine, but are starting to get concerned about its instability. Recently we've identified needs to rerun major queries that return zero records the first t...

Hello, we are facing a very odd issue with AWS Glue. When we run AWS Glue Crawler against the RDS Postgres v14 we get very vague error logs from CloudWatch (see below). Now, admittedly the schema is...