We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: On the estimation of correlation in a binary sequence model

Abstract: We consider a binary sequence generated by thresholding a hidden continuous sequence. The hidden variables are assumed to have a compound symmetry covariance structure with a single parameter characterizing the common correlation. We study the parameter estimation problem under such one-parameter models. We demonstrate that maximizing the likelihood function does not yield consistent estimates for the correlation. We then formally prove the nonestimability of the parameter by deriving a non-vanishing minimax lower bound. This counter-intuitive phenomenon provides an interesting insight that one-bit information of each latent variable is not sufficient to consistently recover their common correlation. On the other hand, we further show that trinary data generated from the hidden variables can consistently estimate the correlation with parametric convergence rate. Thus we reveal a phase transition phenomenon regarding the discretization of latent continuous variables while preserving the estimability of the correlation. Numerical experiments are performed to validate the conclusions.
Comments: 23 pages, 5 figures
Subjects: Statistics Theory (math.ST); Applications (stat.AP); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:1712.09694 [math.ST]
  (or arXiv:1712.09694v2 [math.ST] for this version)

Submission history

From: Haolei Weng [view email]
[v1] Wed, 27 Dec 2017 22:19:19 GMT (327kb,D)
[v2] Mon, 2 Sep 2019 19:27:54 GMT (2188kb,D)

Link back to: arXiv, form interface, contact.