We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Operator Fusion in XLA: Analysis and Evaluation

Abstract: Machine learning (ML) compilers are an active area of research because they offer the potential to automatically speedup tensor programs. Kernel fusion is often cited as an important optimization performed by ML compilers. However, there exists a knowledge gap about how XLA, the most common ML compiler, applies this nuanced optimization, what kind of speedup it can afford, and what low-level effects it has on hardware. Our paper aims to bridge this knowledge gap by studying key compiler passes of XLA's source code. Our evaluation on a reinforcement learning environment Cartpole shows how different fusion decisions in XLA are made in practice. Furthermore, we implement several XLA kernel fusion strategies that can achieve up to 10.56x speedup compared to our baseline implementation.
Comments: Course Paper, University of Toronto
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2301.13062 [cs.LG]
  (or arXiv:2301.13062v1 [cs.LG] for this version)

Submission history

From: Daniel Snider [view email]
[v1] Mon, 30 Jan 2023 17:03:33 GMT (2546kb,D)

Link back to: arXiv, form interface, contact.