We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AR

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Hardware Architecture

Title: Reduced Softmax Unit for Deep Neural Network Accelerators

Authors: Raghuram S
Abstract: The Softmax activation layer is a very popular Deep Neural Network (DNN) component when dealing with multi-class prediction problems. However, in DNN accelerator implementations it creates additional complexities due to the need for computation of the exponential for each of its inputs. In this brief we propose a simplified version of the activation unit for accelerators, where only a comparator unit produces the classification result, by choosing the maximum among its inputs. Due to the nature of the activation function, we show that this result is always identical to the classification produced by the Softmax layer.
Subjects: Hardware Architecture (cs.AR)
Cite as: arXiv:2201.04562 [cs.AR]
  (or arXiv:2201.04562v1 [cs.AR] for this version)

Submission history

From: Raghuram S [view email]
[v1] Tue, 28 Dec 2021 02:06:43 GMT (355kb,D)

Link back to: arXiv, form interface, contact.