We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Optimizing the Performative Risk under Weak Convexity Assumptions

Authors: Yulai Zhao
Abstract: In performative prediction, a predictive model impacts the distribution that generates future data, a phenomenon that is being ignored in classical supervised learning. In this closed-loop setting, the natural measure of performance named performative risk ($\mathrm{PR}$), captures the expected loss incurred by a predictive model \emph{after} deployment. The core difficulty of using the performative risk as an optimization objective is that the data distribution itself depends on the model parameters. This dependence is governed by the environment and not under the control of the learner. As a consequence, even the choice of a convex loss function can result in a highly non-convex $\mathrm{PR}$ minimization problem. Prior work has identified a pair of general conditions on the loss and the mapping from model parameters to distributions that implies the convexity of the performative risk. In this paper, we relax these assumptions and focus on obtaining weaker notions of convexity, without sacrificing the amenability of the $\mathrm{PR}$ minimization problem for iterative optimization methods.
Comments: Neurips 2022 Workshop on Optimization for Machine Learning
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2209.00771 [cs.LG]
  (or arXiv:2209.00771v4 [cs.LG] for this version)

Submission history

From: Yulai Zhao [view email]
[v1] Fri, 2 Sep 2022 01:07:09 GMT (30kb)
[v2] Mon, 12 Sep 2022 15:23:26 GMT (32kb)
[v3] Fri, 23 Sep 2022 17:15:27 GMT (33kb)
[v4] Fri, 21 Oct 2022 02:25:11 GMT (38kb)

Link back to: arXiv, form interface, contact.