All Content tagged with Analytics

I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/) ``` yfs_category_item_df = glueCo...

What are the performance considerations while using the Redshift Federated Queries to access and query data present in Amazon Aurora RDS PostgreSQL database? The Redshift Zero ETL feature is still in ...

I'm currently integrating AWS Pinpoint with Amplify analytics to track user engagement metrics such as Monthly Active Users (MAU) and Daily Active Users (DAU). While these metrics are visible in the A...

Hi I have created an external table on AWS Glue catalog db . The table points to a lz4 compressed file on an s3. the table definition looks like this ``` CREATE EXTERNAL TABLE `myapplogs`( `ti...

Hello, I have a Glue table based on parquet files in S3 that is partitioned by 3 columns: - event_date_year - event_date_month - event_date_day I want to select data for a list of given event...

Hello AWS Community, I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3 ...

I'm running an EMR Serverless Spark job that uses Delta OSS to handle Delta tables. I previously resolved a configuration issue with EMR Serverless and AWS Glue Data Catalog [here](https://repost.aws...

Hi team, first post, let me know if it provides a good explanation. I'd like to know a way to minimize the effort for data ingestion. We have two options as follows: (1) csv files from a file ser...

Hi All, I would like to create a dashboard by connecting few folders in Amazon Issue Manager - to get live update on # of open SIMs, resolved, pending etc., but im struck on how to create the datase...

I am running an EMR cluster with an attached notebook, and using Apache spark to load/process data however I have not been able to load data into Apache. Whenever I try to run spark.read.csv('s3://buc...

Hello! I am new to AWS Glue and I starting to create data monitoring rules in AWS Glue. I have tried multiple options with CustomSQL but can not seem to find the solution. My problem: I want to check ...

Hi, I have visuals within an analysis that the dataset it's using is already deleted (for the purpose of de-duplication of datasets). We missed the step to replace the dataset and it's no longer showi...