References & Citations
Computer Science > Distributed, Parallel, and Cluster Computing
Title: Energy-efficient Analytics for Geographically Distributed Big Data
(Submitted on 10 Aug 2017 (v1), last revised 26 Aug 2017 (this version, v2))
Abstract: Big data analytics on geographically distributed datasets (across data centers or clusters) has been attracting increasing interests from both academia and industry, but also significantly complicates the system and algorithm designs. In this article, we systematically investigate the geo-distributed big-data analytics framework by analyzing the fine-grained paradigm and the key design principles. We present a dynamic global manager selection algorithm (GMSA) to minimize energy consumption cost by fully exploiting the system diversities in geography and variation over time. The algorithm makes real-time decisions based on the measurable system parameters through stochastic optimization methods, while achieving the performance balances between energy cost and latency. Extensive trace-driven simulations verify the effectiveness and efficiency of the proposed algorithm. We also highlight several potential research directions that remain open and require future elaborations in analyzing geo-distributed big data.
Submission history
From: Peng Zhao [view email][v1] Thu, 10 Aug 2017 12:44:31 GMT (4159kb)
[v2] Sat, 26 Aug 2017 16:50:21 GMT (4160kb)
Link back to: arXiv, form interface, contact.