We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Regression with n$\to$1 by Expert Knowledge Elicitation

Abstract: We consider regression under the "extremely small $n$ large $p$" condition, where the number of samples $n$ is so small compared to the dimensionality $p$ that predictors cannot be estimated without prior knowledge. This setup occurs in personalized medicine, for instance, when predicting treatment outcomes for an individual patient based on noisy high-dimensional genomics data. A remaining source of information is expert knowledge, which has received relatively little attention in recent years. We formulate the inference problem of asking expert feedback on features on a budget, propose an elicitation strategy for a simple "small $n$" setting, and derive conditions under which the elicitation strategy is optimal. Experiments on simulated experts, both on synthetic and genomics data, demonstrate that the proposed strategy can drastically improve prediction accuracy.
Comments: In Proceedings of the 15th IEEE International Conference on Machine Learning and Applications (IEEE ICMLA'16)
Subjects: Machine Learning (cs.LG)
DOI: 10.1109/ICMLA.2016.0131
Cite as: arXiv:1605.06477 [cs.LG]
  (or arXiv:1605.06477v3 [cs.LG] for this version)

Submission history

From: Marta Soare [view email]
[v1] Fri, 20 May 2016 19:19:08 GMT (132kb)
[v2] Sat, 24 Sep 2016 21:58:12 GMT (132kb)
[v3] Tue, 7 Feb 2017 01:39:35 GMT (132kb)

Link back to: arXiv, form interface, contact.