We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Retrieval

Title: Lightweight representation learning for efficient and scalable recommendation

Abstract: Over the past decades, recommendation has become a critical component of many online services such as media streaming and e-commerce. Recent advances in algorithms, evaluation methods and datasets have led to continuous improvements of the state-of-the-art. However, much work remains to be done to make these methods scale to the size of the internet.
Online advertising offers a unique testbed for recommendation at scale. Every day, billions of users interact with millions of products in real-time. Systems addressing this scenario must work reliably at scale. We propose an efficient model (LED, for Lightweight Encoder-Decoder) reaching a new trade-off between complexity, scale and performance. Specifically, we show that combining large-scale matrix factorization with lightweight embedding fine-tuning unlocks state-of-the-art performance at scale. We further provide the detailed description of a system architecture and demonstrate its operation over two months at the scale of the internet. Our design allows serving billions of users across hundreds of millions of items in a few milliseconds using standard hardware.
Comments: 12 pages, 9 figures
Subjects: Information Retrieval (cs.IR)
Cite as: arXiv:2101.00870 [cs.IR]
  (or arXiv:2101.00870v2 [cs.IR] for this version)

Submission history

From: Olivier Koch [view email]
[v1] Mon, 4 Jan 2021 10:29:24 GMT (16007kb,D)
[v2] Mon, 29 Nov 2021 10:40:53 GMT (7773kb,D)

Link back to: arXiv, form interface, contact.