Data logging and visualization@ AWS EC2

As Gary said, you can use CloudWatch to visualize some EC2 metrics. It's also possible to collect custom metrics [1] for things like RAM that are not collected on EC2 instances by default. These have a cost. In addition, CloudWatch Logs can be used, these also have a cost that can get expensive. CloudWatch Logs can collect logs from the EC2 instance via an agent and then you can visualize the logs into graphs or filter the logs. [2]

• [1] https://repost.aws/knowledge-center/cloudwatch-push-custom-metrics
• [2] https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/AnalyzingLogData.html

We are working on a Control command room in which we have data from 19 different location and we have logged that data @local server now we want to log the data in AWS EC2 and also want to visualize that data on Dashboard having facility of graphs, pie charts etc.

This project is about water distribution system monitoring of 19 districts and parameters like voltage current, power consumption, water discharge , motor running hours etc will be used to make comparisons between two or more locations.

It sounds like you should be having a deeper conversation with an AWS Solution Architect.

In any case, what form is the data in on the server? If you have it logging to a file, then that file can be sent to CloudWatch Logs via an agent and you can use the Analysis link I shared to explore how to filter and expose the specific data points you are looking for.

The reason I say you should speak with a Solution Architect is because there may be better options like storing in S3 and querying the data in something like Athena and/or QuickSight. This option will probably be more cost effective than CloudWatch Logs.

Thanks Gary and Shlomo for your support. And I do agree what you have suggested.

I believe not to put data on ec2 we will end up consuming more amount of tariff or consumption on ec2. Rather we will try to keep data on a data warehouse like RDS serverless or S3 and using Athena service where we can query the data. For dashboarding we can ingest data from different sources to QuickSight and create custom dashboards as we require.