We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IR

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Towards Resolving Propensity Contradiction in Offline Recommender Learning

Abstract: We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing propensity-based methods can suffer significantly from the propensity estimation bias. In fact, most of the previous IPS-based methods require some amount of missing-completely-at-random (MCAR) data to accurately estimate the propensity. This leads to a critical self-contradiction; IPS is ineffective without MCAR data, even though it originally aims to learn recommenders from only missing-not-at-random feedback. To resolve this propensity contradiction, we derive a propensity-independent generalization error bound and propose a novel algorithm to minimize the theoretical bound via adversarial learning. Our theory and algorithm do not require a propensity estimation procedure, thereby leading to a well-performing rating predictor without the true propensity information. Extensive experiments demonstrate that the proposed approach is superior to a range of existing methods both in rating prediction and ranking metrics in practical settings without MCAR data.
Comments: IJCAI2022
Subjects: Machine Learning (stat.ML); Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as: arXiv:1910.07295 [stat.ML]
  (or arXiv:1910.07295v6 [stat.ML] for this version)

Submission history

From: Yuta Saito [view email]
[v1] Wed, 16 Oct 2019 11:41:17 GMT (15kb)
[v2] Thu, 14 Nov 2019 16:36:09 GMT (878kb,D)
[v3] Fri, 13 Dec 2019 21:04:32 GMT (878kb,D)
[v4] Wed, 29 Jan 2020 13:07:20 GMT (854kb,D)
[v5] Thu, 18 Jun 2020 07:56:23 GMT (393kb,D)
[v6] Thu, 21 Apr 2022 01:35:26 GMT (392kb,D)

Link back to: arXiv, form interface, contact.