Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Gini estimation under infinite variance
(Submitted on 5 Jul 2017 (v1), revised 17 Jul 2017 (this version, v3), latest version 17 Dec 2017 (v4))
Abstract: We study different approaches to the estimation of the Gini index in presence of a fat-tailed data generator process, i.e. one in the stable distribution class with finite mean but infinite variance (i.e. with tail index $\alpha\in(1,2)$). We show that, in such a case, the Gini coefficient can not be reliably estimated using conventional nonparametric methods, because of a downward bias that emerges in case of fat tails.
We start by discussing how the nonparametric estimator of the Gini index undergoes a phase transition in the symmetry structure of its asymptotic distribution, as the data distribution shifts from the domain of attraction of a light-tailed distribution to that of a fat-tailed one, especially in the case of infinite variance. We show how the nonparametric Gini bias increases with lower values of $\alpha$.
We then prove that maximum likelihood estimation outperforms nonparametric methods, requiring a much smaller sample size to reach efficiency.
Finally, for fat-tailed data, we provide a simple correction mechanism to the small sample bias of the nonparametric estimator based on the distance between the mode and the mean of its asymptotic distribution.
Submission history
From: Nassim Nicholas Taleb [view email][v1] Wed, 5 Jul 2017 12:46:35 GMT (4289kb,D)
[v2] Thu, 6 Jul 2017 11:40:38 GMT (4021kb,D)
[v3] Mon, 17 Jul 2017 21:38:37 GMT (3873kb,D)
[v4] Sun, 17 Dec 2017 23:17:47 GMT (153kb,D)
Link back to: arXiv, form interface, contact.