References & Citations
Computer Science > Multimedia
Title: Fast Adaptive Algorithm for Robust Evaluation of Quality of Experience
(Submitted on 29 Jul 2014 (v1), last revised 22 Oct 2014 (this version, v2))
Abstract: Outlier detection is an integral part of robust evaluation for crowdsourceable Quality of Experience (QoE) and has attracted much attention in recent years. In QoE for multimedia, outliers happen because of different test conditions, human errors, abnormal variations in context, {etc}. In this paper, we propose a simple yet effective algorithm for outlier detection and robust QoE evaluation named iterative Least Trimmed Squares (iLTS). The algorithm assigns binary weights to samples, i.e., 0 or 1 indicating if a sample is an outlier, then the outlier-trimmed subset least squares solutions give robust ranking scores. An iterative optimization is carried alternatively between updating weights and ranking scores which converges to a local optimizer in finite steps. In our test setting, iLTS is up to 190 times faster than LASSO-based methods with a comparable performance. Moreover, a varied version of this method shows adaptation in outlier detection, which provides an automatic detection to determine whether a data sample is an outlier without \emph{a priori} knowledge about the amount of the outliers. The effectiveness and efficiency of iLTS are demonstrated on both simulated examples and real-world applications. A Matlab package is provided to researchers exploiting crowdsourcing paired comparison data for robust ranking.
Submission history
From: Ming Yan [view email][v1] Tue, 29 Jul 2014 06:20:42 GMT (7225kb,D)
[v2] Wed, 22 Oct 2014 05:56:35 GMT (7225kb,D)
Link back to: arXiv, form interface, contact.