Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Efficient Learning for Crowdsourced Regression
(Submitted on 28 Feb 2017 (this version), latest version 8 Oct 2018 (v3))
Abstract: Crowdsourcing platforms emerged as popular venues for purchasing human intelligence at low cost for large volume of tasks. As many low-paid workers are prone to give noisy answers, one of the fundamental questions is how to identify more reliable workers and exploit this heterogeneity to infer the true answers. Despite significant research efforts for classification tasks with discrete answers, little attention has been paid to regression tasks where the answers take continuous values. We consider the task of recovering the position of target objects, and introduce a new probabilistic model capturing the heterogeneity of the workers. We propose the belief propagation (BP) algorithm for inferring the positions and prove that it achieves optimal mean squared error by comparing its performance to that of an oracle estimator. Our experimental results on synthetic datasets confirm our theoretical predictions. We further emulate a crowdsourcing system using PASCAL visual object classes datasets and show that de-noising the crowdsourced data using BP can significantly improve the performance for the downstream vision task.
Submission history
From: Jungseul Ok [view email][v1] Tue, 28 Feb 2017 16:15:13 GMT (6457kb,D)
[v2] Tue, 23 May 2017 11:27:14 GMT (1875kb,D)
[v3] Mon, 8 Oct 2018 17:02:49 GMT (3776kb,D)
Link back to: arXiv, form interface, contact.