We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Bring the BitCODE -- Moving Compute and Data in Distributed Heterogeneous Systems

Authors: Wenbin Lu (1), Luis E. Peña (2), Pavel Shamis (2), Valentin Churavy (3), Barbara Chapman (1), Steve Poole (4) ((1) Stony Brook University, (2) Arm Research, (3) MIT, (4) Los Alamos National Laboratory)
Abstract: In this paper, we present a framework for moving compute and data between processing elements in a distributed heterogeneous system. The implementation of the framework is based on the LLVM compiler toolchain combined with the UCX communication framework. The framework can generate binary machine code or LLVM bitcode for multiple CPU architectures and move the code to remote machines while dynamically optimizing and linking the code on the target platform. The remotely injected code can recursively propagate itself to other remote machines or generate new code. The goal of this paper is threefold: (a) to present an architecture and implementation of the framework that provides essential infrastructure to program a new class of disaggregated systems wherein heterogeneous programming elements such as compute nodes and data processing units (DPUs) are distributed across the system, (b) to demonstrate how the framework can be integrated with modern, high-level programming languages such as Julia, and (c) to demonstrate and evaluate a new class of eXtended Remote Direct Memory Access (X-RDMA) communication operations that are enabled by this framework. To evaluate the capabilities of the framework, we used a cluster with Fujitsu CPUs and heterogeneous cluster with Intel CPUs and BlueField-2 DPUs interconnected using high-performance RDMA fabric. We demonstrated an X-RDMA pointer chase application that outperforms an RDMA GET-based implementation by 70% and is as fast as Active Messages, but does not require function predeployment on remote platforms.
Comments: 11 pages, 12 figures, to be published in IEEE CLUSTER 2022
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)
DOI: 10.1109/CLUSTER51413.2022.00017
Cite as: arXiv:2208.01154 [cs.DC]
  (or arXiv:2208.01154v1 [cs.DC] for this version)

Submission history

From: Luis E. Peña [view email]
[v1] Mon, 1 Aug 2022 22:06:32 GMT (382kb,D)

Link back to: arXiv, form interface, contact.