Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: The Most Difference in Means: A Statistic for Null and Near-Zero Results
(Submitted on 4 Jan 2022 (this version), latest version 24 May 2022 (v4))
Abstract: Two-sample p-values test for statistical significance. Yet p-values cannot determine if a result has a negligible (near-zero) effect size, nor compare evidence for negligibility among independent studies. We propose the most difference in means ({\delta}M) statistic to assess the practical insignificance of results by measuring the evidence for a negligible effect size. Both {\delta}M and the relative form of {\delta}M allow hypothesis testing for negligibility and outperform other candidate statistics in identifying results with stronger evidence of negligible effect. We compile results from broadly related experiments and use the relative {\delta}M to compare practical insignificance across different measurement methods and experiment models. Reporting the relative {\delta}M builds consensus for negligible effect size by making near-zero results more quantitative and publishable.
Submission history
From: Bruce Corliss [view email][v1] Tue, 4 Jan 2022 16:46:44 GMT (6425kb)
[v2] Thu, 6 Jan 2022 04:54:42 GMT (6425kb)
[v3] Fri, 1 Apr 2022 17:41:04 GMT (6464kb)
[v4] Tue, 24 May 2022 23:39:03 GMT (6185kb)
Link back to: arXiv, form interface, contact.