We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks

Abstract: Matrix completion problems arise in many applications including recommendation systems, computer vision, and genomics. Increasingly larger neural networks have been successful in many of these applications, but at considerable computational costs. Remarkably, taking the width of a neural network to infinity allows for improved computational performance. In this work, we develop an infinite width neural network framework for matrix completion that is simple, fast, and flexible. Simplicity and speed come from the connection between the infinite width limit of neural networks and kernels known as neural tangent kernels (NTK). In particular, we derive the NTK for fully connected and convolutional neural networks for matrix completion. The flexibility stems from a feature prior, which allows encoding relationships between coordinates of the target matrix, akin to semi-supervised learning. The effectiveness of our framework is demonstrated through competitive results for virtual drug screening and image inpainting/reconstruction. We also provide an implementation in Python to make our framework accessible on standard hardware to a broad audience.
Subjects: Machine Learning (cs.LG)
DOI: 10.1073/pnas.2115064119
Cite as: arXiv:2108.00131 [cs.LG]
  (or arXiv:2108.00131v2 [cs.LG] for this version)

Submission history

From: Adityanarayanan Radhakrishnan [view email]
[v1] Sat, 31 Jul 2021 02:40:50 GMT (22706kb,D)
[v2] Tue, 22 Feb 2022 01:49:09 GMT (22708kb,D)

Link back to: arXiv, form interface, contact.