visualize gaps in Timestream recods for missing time intervals

Question

Hi everyone. when we are storing telemetry data in Timestream, we face with gap in records sometimes. for example interval is every 10 mins and we have 12.00 , 12.10, 12.30 timestamps records. so 12.20 is missed. how we can visualize or report it with Deequ or GreatExpectations(GX)?
as far I know we can use Grafana and Quicksight to visualize it easily. but I need to know how we can use Deequ and GX for this. any opinion?
Thanks

AJ · Answer

Hi, you can use the ```interpolate``` function to achieve this. In this [blog](https://aws.amazon.com/blogs/database/data-preparation-for-machine-learning-using-amazon-timestream/) - we've provided a blue print how this can be done.  You can use ```interpolate_linear``` or ```interpolate_fill```. For more details on the functions see [here](https://docs.aws.amazon.com/timestream/latest/developerguide/timeseries-specific-constructs.functions.interpolation.html)

visualize gaps in Timestream recods for missing time intervals

Add your answer

Relevant content