We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Data Volume-aware Computation Task Scheduling for Smart Grid Data Analytic Applications

Abstract: Emerging smart grid applications analyze large amounts of data collected from millions of meters and systems to facilitate distributed monitoring and real-time control tasks. However, current parallel data processing systems are designed for common applications, unaware of the massive volume of the collected data, causing long data transfer delay during the computation and slow response time of smart grid systems. A promising direction to reduce delay is to jointly schedule computation tasks and data transfers. We identify that the smart grid data analytic jobs require the intermediate data among different computation stages to be transmitted orderly to avoid network congestion. This new feature prevents current scheduling algorithms from being efficient. In this work, an integrated computing and communication task scheduling scheme is proposed. The mathematical formulation of smart grid data analytic jobs scheduling problem is given, which is unsolvable by existing optimization methods due to the strongly coupled constraints. Several techniques are combined to linearize it for adapting the Branch and Cut method. Based on the topological information in the job graph, the Topology Aware Branch and Cut method is further proposed to speed up searching for optimal solutions. Numerical results demonstrate the effectiveness of the proposed method.
Comments: Accepted to appear in IEEE ICC 2023. The source code is available at Github: this https URL
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF); Systems and Control (eess.SY)
Cite as: arXiv:2301.11831 [cs.DC]
  (or arXiv:2301.11831v2 [cs.DC] for this version)

Submission history

From: Binquan Guo [view email]
[v1] Fri, 27 Jan 2023 16:34:00 GMT (74kb,D)
[v2] Tue, 31 Jan 2023 09:18:18 GMT (74kb,D)
[v3] Thu, 2 Feb 2023 08:49:04 GMT (75kb,D)

Link back to: arXiv, form interface, contact.