We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Noise-Contrastive Estimation for Multivariate Point Processes

Abstract: The log-likelihood of a generative model often involves both positive and negative terms. For a temporal multivariate point process, the negative term sums over all the possible event types at each time and also integrates over all the possible times. As a result, maximum likelihood estimation is expensive. We show how to instead apply a version of noise-contrastive estimation---a general parameter estimation method with a less expensive stochastic objective. Our specific instantiation of this general idea works out in an interestingly non-trivial way and has provable guarantees for its optimality, consistency and efficiency. On several synthetic and real-world datasets, our method shows benefits: for the model to achieve the same level of log-likelihood on held-out data, our method needs considerably fewer function evaluations and less wall-clock time.
Comments: NeurIPS 2020 camera-ready
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2011.00717 [cs.LG]
  (or arXiv:2011.00717v1 [cs.LG] for this version)

Submission history

From: Hongyuan Mei [view email]
[v1] Mon, 2 Nov 2020 04:09:33 GMT (5729kb,D)

Link back to: arXiv, form interface, contact.