Fueled by increasing demand of big data processing, distributed storage systems have been more and more widely used by enterprises. However, in these systems, few storage nodes holding enormous amount of hotspot data could become bottlenecks. This stems from the fact that most typical distributed storage systems mainly provide data amount balancing mechanisms without considering the difference of access load between different storage nodes. To eliminate bottlenecks and tune the performance, there is a demand for such systems to employ a work-load aware balancing and resource management framework to optimize the performance and computation resource utilization.#R##N##R##N#In this paper, we propose WABRM, a load balancing and resource management framework for Work-load Aware Balancing and Resource Management in Swift, a typical distributed storage system. By designing such an optimization framework, it is possible to eliminate bottlenecks caused by hotspot data. Our experimental results show that the framework can achieve its goals.
['Zhenhua Wang', 'Haopeng Chen', 'Yunmeng Ban']
WABRM: A Work-Load Aware Balancing and Resource Management Framework for Swift on Cloud