We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: A strong converse bound for multiple hypothesis testing, with applications to high-dimensional estimation

Abstract: In statistical inference problems, we wish to obtain lower bounds on the minimax risk, that is to bound the performance of any possible estimator. A standard technique to obtain risk lower bounds involves the use of Fano's inequality. In an information-theoretic setting, it is known that Fano's inequality typically does not give a sharp converse result (error lower bound) for channel coding problems. Moreover, recent work has shown that an argument based on binary hypothesis testing gives tighter results. We adapt this technique to the statistical setting, and argue that Fano's inequality can always be replaced by this approach to obtain tighter lower bounds that can be easily computed and are asymptotically sharp. We illustrate our technique in three applications: density estimation, active learning of a binary classifier, and compressed sensing, obtaining tighter risk lower bounds in each case.
Comments: In the latest version, the value of $\lambda$ in the statements of Lemma 4.1 and Proposition 4.2 is restricted to the interval $(0,1]$. This is the correct condition, rather than $\lambda>0$ stated in the journal version below
Subjects: Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)
Journal reference: Electronic Journal of Statistics, Vol. 12, No. 1, pp. 1126-1149, 2018
DOI: 10.1214/18-EJS1419
Cite as: arXiv:1706.04410 [cs.IT]
  (or arXiv:1706.04410v3 [cs.IT] for this version)

Submission history

From: Ramji Venkataramanan [view email]
[v1] Wed, 14 Jun 2017 11:21:02 GMT (24kb)
[v2] Wed, 7 Mar 2018 16:47:33 GMT (23kb)
[v3] Wed, 4 Apr 2018 18:54:51 GMT (23kb)

Link back to: arXiv, form interface, contact.