We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: How to Distribute Computation in Networks

Abstract: In network function computation is as a means to reduce the required communication flow in terms of number of bits transmitted per source symbol. However, the rate region for the function computation problem in general topologies is an open problem, and has only been considered under certain restrictive assumptions (e.g. tree networks, linear functions, etc.). In this paper, we propose a new perspective for distributing computation, and formulate a flow-based delay cost minimization problem that jointly captures the costs of communications and computation. We introduce the notion of entropic surjectivity as a measure to determine how sparse the function is and to understand the limits of computation. Exploiting Little's law for stationary systems, we provide a connection between this new notion and the computation processing factor that reflects the proportion of flow that requires communications. This connection gives us an understanding of how much a node (in isolation) should compute to communicate the desired function within the network without putting any assumptions on the topology. Our analysis characterizes the functions only via their entropic surjectivity, and provides insight into how to distribute computation. We numerically test our technique for search, MapReduce, and classification tasks, and infer for each task how sensitive the processing factor to the entropic surjectivity is.
Comments: to appear in IEEE International Conference on Computer Communications (INFOCOM), Beijing, China, Apr. 2020
Subjects: Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)
Cite as: arXiv:1912.03531 [cs.IT]
  (or arXiv:1912.03531v2 [cs.IT] for this version)

Submission history

From: Derya Malak [view email]
[v1] Sat, 7 Dec 2019 17:01:00 GMT (215kb)
[v2] Wed, 22 Jan 2020 13:26:08 GMT (207kb)

Link back to: arXiv, form interface, contact.