Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Analyzing and Mitigating the Impact of Permanent Faults on a Systolic Array Based Neural Network Accelerator
(Submitted on 11 Feb 2018 (v1), last revised 17 Feb 2018 (this version, v2))
Abstract: Due to their growing popularity and computational cost, deep neural networks (DNNs) are being targeted for hardware acceleration. A popular architecture for DNN acceleration, adopted by the Google Tensor Processing Unit (TPU), utilizes a systolic array based matrix multiplication unit at its core. This paper deals with the design of fault-tolerant, systolic array based DNN accelerators for high defect rate technologies. To this end, we empirically show that the classification accuracy of a baseline TPU drops significantly even at extremely low fault rates (as low as $0.006\%$). We then propose two novel strategies, fault-aware pruning (FAP) and fault-aware pruning+retraining (FAP+T), that enable the TPU to operate at fault rates of up to $50\%$, with negligible drop in classification accuracy (as low as $0.1\%$) and no run-time performance overhead. The FAP+T does introduce a one-time retraining penalty per TPU chip before it is deployed, but we propose optimizations that reduce this one-time penalty to under 12 minutes. The penalty is then amortized over the entire lifetime of the TPU's operation.
Submission history
From: Jeff (Jun) Zhang [view email][v1] Sun, 11 Feb 2018 19:51:35 GMT (310kb,D)
[v2] Sat, 17 Feb 2018 06:19:12 GMT (310kb,D)
Link back to: arXiv, form interface, contact.