Statistics Theory

New submissions

• New submissions
• Cross-lists
• Replacements

New submissions for Mon, 13 May 24

[1]  arXiv:2405.06428 [pdf, other]

Title: Weighted past and paired dynamic varentropy measures, their properties and usefulness

Authors: Shital Saha, Suchandan Kayal

Subjects: Statistics Theory (math.ST)

We introduce two uncertainty measures, say weighted past varentropy (WPVE) and weighted paired dynamic varentropy (WPDVE). Several properties have been studied for these proposed measures. The effect of the monotone transformation for these measures have been discussed. We have obtained an upper bound of the WPVE using the weighted past Shannon entropy. A lower bound of the WPVE is also obtained. The WPVE has been studied for proportional reversed hazard rate (PRHR) models. Upper and lower bounds of the WPDVE have been derived. We propose non-parametric kernel estimates of the WPVE and WPDVE. Further, maximum likelihood estimation has been employed to estimate WPVE and WPDVE for an exponential population. A numerical simulation is provided to observe the behaviour of the proposed estimates. Finally, we have analysed a real data set and obtain the estimated values of WPVE.

[2]  arXiv:2405.06437 [pdf, ps, other]

Title: Generalized van Trees inequality: Local minimax bounds for non-smooth functionals and irregular statistical models

Authors: Kenta Takatsu, Arun Kumar Kuchibhotla

Subjects: Statistics Theory (math.ST)

In a decision-theoretic framework, minimax lower bound provides the worst-case performance of estimators relative to a given class of statistical models. For parametric and semiparametric models, the H\'{a}jek--Le Cam local asymptotic minimax (LAM) theorem provides the optimal and sharp asymptotic lower bound. Despite its relative generality, this result comes with limitations as it only applies to the estimation of differentiable functionals under regular statistical models. On the other hand, non-asymptotic minimax lower bounds, such as those based on the reduction to hypothesis testing, do not often yield sharp asymptotic constants. Inspired by the recent improvement of the van Trees inequality and related methods in the literature, we provide new non-asymptotic minimax lower bounds under minimal regularity assumptions, which imply sharp asymptotic constants. The proposed lower bounds do not require the differentiability of functionals or regularity of statistical models, extending the efficiency theory to broader situations where standard approaches fail. Additionally, new lower bounds provide non-asymptotic constants, which can shed light on more refined fundamental limits of estimation in finite samples. We demonstrate that new lower bounds recover many classical results, including the LAM theorem and semiparametric efficiency bounds. We also illustrate the use of the new lower bound by deriving the local minimax lower bound for estimating the density at a point and directionally differentiable parameters.

[3]  arXiv:2405.06477 [pdf, ps, other]

Title: Asymptotic Normality of $U$-Statistics is Equivalent to Convergence in the Wasserstein Distance

Authors: Marius Kroll

Subjects: Statistics Theory (math.ST)

We prove the claim in the title under mild conditions which are usually satisfied when trying to establish asymptotic normality. We assume strictly stationary and absolutely regular data.

Cross-lists for Mon, 13 May 24

[4]  arXiv:2405.06167 (cross-list from math-ph) [pdf, ps, other]

Title: Integrability-preserving regularizations of Laplacian Growth

Authors: Razvan Teodorescu

Journal-ref: Math. Model. Nat. Phenom. 15 (2020) 9

Subjects: Mathematical Physics (math-ph); Dynamical Systems (math.DS); Statistics Theory (math.ST)

The Laplacian Growth (LG) model is known as a universality class of scale-free aggregation models in two dimensions, characterized by classical integrability and featuring finite-time boundary singularity formation. A discrete counterpart, Diffusion-Limited Aggregation (or DLA), has a similar local growth law, but significantly different global behavior. For both LG and DLA, a proper description for the scaling properties of long-time solutions is not available yet. In this note, we outline a possible approach towards finding the correct theory yielding a regularized LG and its relation to DLA.

[5]  arXiv:2405.06200 (cross-list from math-ph) [pdf, ps, other]

Title: Restricted isometric compression of sparse datasets into low-dimensional varieties

Authors: Vasile Pop, Iuliana Teodorescu, Razvan Teodorescu

Subjects: Mathematical Physics (math-ph); Functional Analysis (math.FA); Optimization and Control (math.OC); Representation Theory (math.RT); Statistics Theory (math.ST)

This article extends the known restricted isometric projection of sparse datasets in Euclidean spaces $\mathbb{R}^N$ down into low-dimensional subspaces $\mathbb{R}^k, k \ll N,$ to the case of low-dimensional varieties $\mathcal{M} \subset \mathbb{R}^N,$ of codimension $N - k = \omega(N)$. Applications to structured/hierarchical datasets are considered.

[6]  arXiv:2405.06397 (cross-list from physics.data-an) [pdf, other]

Title: Statistical divergences in high-dimensional hypothesis testing and a modern technique for estimating them

Authors: Jeremy J.H. Wilkinson, Christopher G. Lester

Subjects: Data Analysis, Statistics and Probability (physics.data-an); High Energy Physics - Experiment (hep-ex); High Energy Physics - Phenomenology (hep-ph); Statistics Theory (math.ST)

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between the population distributions of observed data and competing models, justifying their use as the basis of a hypothesis test. We go on to point out how modern techniques for functional optimization let us estimate many divergences, without the need for population likelihood functions, using samples from two distributions alone. We use a physics-based example to show how the proposed two-sample test can be implemented in practice, and discuss the necessary steps required to mature the ideas presented into an experimental framework.

Replacements for Mon, 13 May 24

[7]  arXiv:2207.13442 (replaced) [pdf, ps, other]

Title: Different informational characteristics of cubic transmuted distributions

Authors: Shital Saha, Suchandan Kayal, N. Balakrishnan

Subjects: Statistics Theory (math.ST)

[8]  arXiv:2301.09289 (replaced) [pdf, ps, other]

Title: Fundamental Limits of Spectral Clustering in Stochastic Block Models

Authors: Anderson Ye Zhang

Subjects: Statistics Theory (math.ST); Social and Information Networks (cs.SI); Spectral Theory (math.SP)

[9]  arXiv:2303.12051 (replaced) [pdf, other]

Title: A Novel and Optimal Spectral Method for Permutation Synchronization

Authors: Duc Nguyen, Anderson Ye Zhang

Subjects: Statistics Theory (math.ST); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Spectral Theory (math.SP)

[10]  arXiv:2311.04748 (replaced) [pdf, other]

Title: Intrinsic Bayesian Cramér-Rao Bound with an Application to Covariance Matrix Estimation

Authors: Florent Bouchard, Alexandre Renaux, Guillaume Ginolhac, Arnaud Breloy

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[11]  arXiv:2405.02462 (replaced) [pdf, other]

Title: Finite Sample Analysis and Bounds of Generalization Error of Gradient Descent in In-Context Linear Regression

Authors: Karthik Duraisamy

Subjects: Statistics Theory (math.ST); Numerical Analysis (math.NA); Probability (math.PR)

[12]  arXiv:2302.10840 (replaced) [pdf, other]

Title: Valid Inference for Machine Learning Model Parameters

Authors: Neil Dey, Jonathan P. Williams

Comments: 35 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[13]  arXiv:2405.02928 (replaced) [pdf, other]

Title: Probabilistic cellular automata with local transition matrices: synchronization, ergodicity, and inference

Authors: Erhan Bayraktar, Fei Lu, Mauro Maggioni, Ruoyu Wu, Sichen Yang

Comments: 32 pages, 3 figures

Subjects: Probability (math.PR); Statistics Theory (math.ST)

• New submissions
• Cross-lists
• Replacements