We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Implementing the ICE Estimator in Multilayer Perceptron Classifiers

Authors: Tyler Ward
Abstract: This paper describes the techniques used to implement the ICE estimator for a multilayer perceptron model, and reviews the performance of the resulting models. The ICE estimator is implemented in the Apache Spark MultilayerPerceptronClassifier, and shown in cross-validation to outperform the stock MultilayerPerceptronClassifier that uses unadjusted MLE (cross-entropy) loss. The resulting models have identical runtime performance, and similar fitting performance to the stock MLP implementations. Additionally, this approach requires no hyper-parameters, and is therefore viable as a drop-in replacement for cross-entropy optimizing multilayer perceptron classifiers wherever overfitting may be a concern.
Subjects: Machine Learning (cs.LG); Computation (stat.CO)
Cite as: arXiv:2007.06157 [cs.LG]
  (or arXiv:2007.06157v1 [cs.LG] for this version)

Submission history

From: Tyler Ward [view email]
[v1] Mon, 13 Jul 2020 02:49:51 GMT (16kb,D)

Link back to: arXiv, form interface, contact.