We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.AP

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Applications

Title: The risk of bias in denoising methods

Authors: Kendrick Kay
Abstract: Experimental datasets are growing rapidly in size, scope, and detail, but the value of these datasets is limited by unwanted measurement noise. It is therefore tempting to apply analysis techniques that attempt to reduce noise and enhance signals of interest. In this paper, we draw attention to the possibility that denoising methods may introduce bias and lead to incorrect scientific inferences. To present our case, we first review the basic statistical concepts of bias and variance. Denoising techniques typically reduce variance observed across repeated measurements, but this can come at the expense of introducing bias to the average expected outcome. We then conduct three simple simulations that provide concrete examples of how bias may manifest in everyday situations. These simulations reveal several findings that may be surprising and counterintuitive: (i) different methods can be equally effective at reducing variance but some incur bias while others do not, (ii) identifying methods that better recover ground truth does not guarantee the absence of bias, (iii) bias can arise even if one has specific knowledge of properties of the signal of interest. We suggest that researchers should consider and possibly quantify bias before deploying denoising methods on important research data.
Comments: 19 pages, 4 figures (v2 update to fix author information)
Subjects: Applications (stat.AP); Image and Video Processing (eess.IV); Quantitative Methods (q-bio.QM)
Cite as: arXiv:2201.09351 [stat.AP]
  (or arXiv:2201.09351v2 [stat.AP] for this version)

Submission history

From: Kendrick Kay [view email]
[v1] Sun, 23 Jan 2022 19:57:57 GMT (3980kb)
[v2] Wed, 26 Jan 2022 01:02:21 GMT (3980kb)

Link back to: arXiv, form interface, contact.