Design and implementation of a load balancer in openstack

Abstract

In modern distributed computing environments, efficient load balancing is paramount for optimizing resource utilization and ensuring seamless service delivery. This research presents an innovative approach to load balancing that dynamically distributes incoming requests among servers based on their performance metrics. Weighted Round Robin assigns weights to servers according to their capacities and performance characteristics, enabling more proportional workload distribution and enhanced system performance. OpenStack, as a versatile open-source cloud computing platform, forms the backbone of this architecture, providing the necessary infrastructure for implementing and managing cloud services. Additionally, the integration of a Virtual Network Function (VNF) within the OpenStack environment acts as a router, facilitating seamless communication between components and demonstrating the practical application of network function virtualization in enhancing network efficiency. To further enhance system reliability, proactive measures are implemented to prevent server overload situations. Servers automatically stop accepting new requests when their resource utilization exceeds predefined thresholds, mitigating the risk of performance degradation or system failure. Additionally, a fail-safe mechanism is employed where the load balancer queues incoming requests during server unavailability, ensuring uninterrupted service delivery until servers are ready to accept requests again. These proactive measures bolster system resilience and maintain service continuity in the face of transient server failures or high demand periods. Critical to the load balancing architecture is the integration of a Health Checker component, to provide real-time monitoring and visualization of server metrics within the terminal interface. Through these integrated components and advanced techniques, the proposed load balancing framework offers a robust solution for optimizing resource allocation, enhancing system reliability, and ensuring uninterrupted service availability in dynamic computing environments.