Skip to content

Regarding AWS open telemetry and Prometheus

0

Is it possible to integrate opentelemetry(ADOT) and promethus managed by AWS with a data lake. The data lake could be both on edge or on AWS? If yes then how does it work? How can oepntemetry and Prometheus be configured to with the data lake to collect metrics and visualise if in grafana.

  • Please accept the answer if it was useful

1 Answer
0
Accepted Answer

How to configure the AWS Distro for OpenTelemetry (ADOT) Collector to scrape from a Prometheus-instrumented application, and send the metrics to Amazon Managed Service for Prometheus.

https://docs.aws.amazon.com/prometheus/latest/userguide/AMP-onboard-ingest-metrics-OpenTelemetry.html#AMP-onboard-ingest-metrics-OpenTelemetry-steps

AWS Managed Prometheus can not be integrated with Data Lake. Prometheus has own data storage

EXPERT
answered a year ago
EXPERT
reviewed a year ago
  • So if I want to perform observability on the data on the data lake what should be done? Can I instrument the data lake with prometheus which and the ADOT collector can scrape metrics from that and send it to AMP?

  • Prometheus has own data storage and you don't have access to it as to Data Lake. You can not connect AWS Managed Prometheus to existing Data Lake

  • Thankyou for your answer. But in this blog: https://docs.aws.amazon.com/wellarchitected/latest/iot-lens-checklist/best-practice-20-1.html - Best Practice 20.1 – Use a data lake for raw telemetry data it talks about storing telemetry data in data lake. What does this mean then? So, if not Prometheus, then can the ADOT collector scrape metrics (telemetry data) and send it to data lake like eg: AWS S3?

  • You can store whatever you want in Data Lake, but Data Lake is not integrated with Prometheus. Prometheus stores data in Time Series DB https://prometheus.io/docs/prometheus/latest/storage/

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.