Hi AWS, I have a workflow which I need to automate as it is having issues of downtime very often i.e.
- There are smart meters which are collecting IoT data and sending it to a Gateway using Radio Frequency. The meters are having a mesh architecture.
- The Gateway is connected to Internet Gateway which is connected to Public load balancer.
- The load balancer then passes the data to the broker service MQTT which is in a private network and the MQTT is running in the Active Passive mode (Blue/Green Deployment). These brokers are running on the Ubuntu machine.
- The broker service is connected to Internal/Private Load Balancer which further redirects to an XYZ system which is running on Windows machine. This is also in Active/Passive Mode and here some background services are also running along with data coming from the meter.
- The XYZ system is connected to a DB cluster (MS SQL Server) which is again running in active passive mode which is having a standby DB instance for Higher Availability.
- There is another public load balancer as indicated in point 2 which is connected to a Web server (IIS Apache) responsible for running API(s) and some other applications. It is a windows machine and sending data to the DB cluster.
- The data is going in a push/pull mechanism and there are cases where the data is lost if the packet size is too large.
- Also there is one Device Management system running on an Ubuntu machine in the public network which is responsible for monitoring.
Firstly, I want to know is there any scope how to improve this architecture by considering all the components I mentioned above. Secondly, I want to implement this on-prem for now not AWS so don't feel offended :). Last but not the least, I need to which all suite of tools can be handy in building CI/CD pipeline for this.
If there will be an example pipeline for something similar it would be great if someone can share the link.
Thanks
We have this workflow on-prem and it is running manually as of now. I have to implement this using CI/CD so I need to know which all things I need to know along with the suite of tools. There is a similar architecture for AWS as well but that has time to be implemented. Hope it makes sense now.
@Gary Mclean, the workflow is setup but everything is manual as of now. It's the Application layer I believe. Our first task is implementing the CI/CD pipeline at the on-prem level and then at AWS. Any suggestions please help!