We gratefully acknowledge support from
the Simons Foundation and member institutions.

Programming Languages

New submissions

[ total of 3 entries: 1-3 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Mon, 17 Jan 22

[1]  arXiv:2201.05587 [pdf, other]
Title: Reusing Auto-Schedules for Efficient DNN Compilation
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Performance (cs.PF); Programming Languages (cs.PL)

Auto-scheduling is a process where a search algorithm automatically explores candidate schedules (program transformations) for a given tensor program on a given hardware platform to improve its performance. However this can be a very time consuming process, depending on the complexity of the tensor program, and capacity of the target device, with often many thousands of program variants being explored. To address this, in this paper we introduce and demonstrate the idea of \emph{tuning-reuse}, a novel approach to identify and re-use auto-schedules between tensor programs. We demonstrate this concept using Deep Neural Networks (DNNs), taking sets of auto-schedules from pre-tuned DNNs, and using them to reduce the inference time of a new DNN. Given a set of pre-tuned schedules, tuning-reuse provides its maximum speedup in less time than auto-scheduling using the state-of-the-art Ansor auto-scheduler. On a set of widely used DNN models, we apply tuning-reuse and achieve maximum speedups between $1.16\times$ and $4.76\times$, while outperforming Ansor when given limited tuning time.

Replacements for Mon, 17 Jan 22

[2]  arXiv:2107.05681 (replaced) [pdf, other]
Title: DARM: Control-Flow Melding for SIMT Thread Divergence Reduction -- Extended Version
Subjects: Programming Languages (cs.PL); Performance (cs.PF)
[3]  arXiv:2110.15425 (replaced) [pdf, other]
Title: Distill: Domain-Specific Compilation for Cognitive Models
Comments: 11 pages, 7 figures
Subjects: Programming Languages (cs.PL)
[ total of 3 entries: 1-3 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2201, contact, help  (Access key information)