Orchestration is a key concept in the world of Cloud computing. It is needed to glue automated tasks together in the right order and to manage complex workflows and processes. Without orchestration you will spend valuable hours of your time connecting to servers and running tasks manually.
You need to add/ remove servers in your pool to serve the traffic load. When a new server comes up, your infrastructure does not know about it or the service it provides. Also, you need to remove entries of left servers from your HAProxy, so traffic doesn’t get directed to them. You suddenly find yourself that you are not the cowboy who can drive tens of thousands of cows over great distances anymore, but a worried owner of puppies. We need such a service discovery system where we can query newly introduced nodes and services, and get notified when a node and service becomes unavailable
In 2015, We observed containers (or dockers) and orchestrators of containers such as Kubernetes as a game changer. This combination will provide an improvement for companies in their application deployment methodology.
Though virtualization technology and Cloud in particular has changed our world for the better, it came with some significant challenges. The biggest being that SysAdmins now need to use tools to understand their infrastructure.