Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Tensor Train polynomial models via Riemannian optimization
(Submitted on 12 May 2016 (this version), latest version 8 Dec 2017 (v3))
Abstract: Modeling interactions between features improves the performance of machine learning solutions in many domains (e.g. recommender systems or sentiment analysis). In this paper, we introduce Exponential Machines (ExM), a predictor that models all interactions of every order. The key idea is to represent an exponentially large tensor of parameters in a factorized format called Tensor Train (TT). The Tensor Train format regularizes the model and lets you control the number of underlying parameters. To train the model, we develop a stochastic version of Riemannian optimization, which allows us to fit tensors with $2^{30}$ entries. We show that the model achieves state-of-the-art performance on synthetic data with high-order interactions.
Submission history
From: Alexander Novikov [view email][v1] Thu, 12 May 2016 13:08:11 GMT (99kb,D)
[v2] Thu, 10 Nov 2016 10:24:08 GMT (182kb,D)
[v3] Fri, 8 Dec 2017 08:17:58 GMT (434kb,D)
Link back to: arXiv, form interface, contact.