Combine results from EvaluateDataQuality in Glue

Question

Is there a way to combine results from EvaluateDataQuality.apply calls for different dataframes, such that a summary can be displayed in the Data quality tab of AWS Glue instead of all individual results? If only individual results get displayed, errors from page 2 onwards are not quickly visible.

Answer

Hello,

As of now we support EvaluateDataQuality results in the format mentioned in below document
[+] https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-crawler-pyspark-transforms-EvaluateDataQuality.html

Also more about Data Quality in below mentioned video link
[+] https://www.youtube.com/watch?v=m4OKjfgsZ00

Combine results from EvaluateDataQuality in Glue

Relevanter Inhalt