We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Zero-Truncated Poisson Regression for Sparse Multiway Count Data Corrupted by False Zeros

Abstract: We propose a novel statistical inference methodology for multiway count data that is corrupted by false zeros that are indistinguishable from true zero counts. Our approach consists of zero-truncating the Poisson distribution to neglect all zero values. This simple truncated approach dispenses with the need to distinguish between true and false zero counts and reduces the amount of data to be processed. Inference is accomplished via tensor completion that imposes low-rank tensor structure on the Poisson parameter space.
Our main result shows that an $N$-way rank-$R$ parametric tensor $\boldsymbol{\mathscr{M}}\in(0,\infty)^{I\times \cdots\times I}$ generating Poisson observations can be accurately estimated by zero-truncated Poisson regression from approximately $IR^2\log_2^2(I)$ non-zero counts under the nonnegative canonical polyadic decomposition. Our result also quantifies the error made by zero-truncating the Poisson distribution when the parameter is uniformly bounded from below. Therefore, under a low-rank multiparameter model, we propose an implementable approach guaranteed to achieve accurate regression in under-determined scenarios with substantial corruption by false zeros. Several numerical experiments are presented to explore the theoretical results.
Comments: 30 pages, 5 figures
Subjects: Methodology (stat.ME); Mathematical Software (cs.MS); Numerical Analysis (math.NA); Statistics Theory (math.ST); Machine Learning (stat.ML)
Report number: SAND2022-0803R
Cite as: arXiv:2201.10014 [stat.ME]
  (or arXiv:2201.10014v2 [stat.ME] for this version)

Submission history

From: Oscar Lopez Dr. [view email]
[v1] Tue, 25 Jan 2022 00:09:48 GMT (128kb,D)
[v2] Wed, 12 Apr 2023 00:02:55 GMT (308kb,D)

Link back to: arXiv, form interface, contact.