We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: UCX Programming Interface for Remote Function Injection and Invocation

Authors: Luis E. Peña (1), Wenbin Lu (2), Pavel Shamis (1), Steve Poole (3) ((1) Arm Research, (2) Stony Brook University, (3) Los Alamos National Laboratory)
Abstract: Network library APIs have historically been developed with the emphasis on data movement, placement, and communication semantics. Many communication semantics are available across a large variety of network libraries, such as send-receive, data streaming, put/get/atomic, RPC, active messages, collective communication, etc. In this work we introduce new compute and data movement APIs that overcome the constraints of the single-program, multiple-data (SPMD) programming model by allowing users to send binary executable code between processing elements. Our proof-of-concept implementation of the API is based on the UCX communication framework and leverages the RDMA network for fast compute migration. We envision the API being used to dispatch user functions from a host CPU to a SmartNIC (DPU), computational storage drive (CSD), or remote servers. In addition, the API can be used by large-scale irregular applications (such as semantic graph analysis), composed of many coordinating tasks operating on a data set so big that it has to be stored on many physical devices. In such cases, it may be more efficient to dynamically choose where code runs as the applications progresses.
Comments: 16 pages, 4 figures, to be published in OpenSHMEM Workshop 2021
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)
Cite as: arXiv:2110.06292 [cs.DC]
  (or arXiv:2110.06292v1 [cs.DC] for this version)

Submission history

From: Luis E. Peña [view email]
[v1] Tue, 12 Oct 2021 19:27:06 GMT (102kb,D)

Link back to: arXiv, form interface, contact.