We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Probability

Title: A Bernstein-type Inequality for Some Mixing Processes and Dynamical Systems with an Application to Learning

Abstract: We establish a Bernstein-type inequality for a class of stochastic processes that include the classical geometrically $\phi$-mixing processes, Rio's generalization of these processes, as well as many time-discrete dynamical systems. Modulo a logarithmic factor and some constants, our Bernstein-type inequality coincides with the classical Bernstein inequality for i.i.d.~data. We further use this new Bernstein-type inequality to derive an oracle inequality for generic regularized empirical risk minimization algorithms and data generated by such processes. Applying this oracle inequality to support vector machines using the Gaussian kernels for both least squares and quantile regression, it turns out that the resulting learning rates match, up to some arbitrarily small extra term in the exponent, the optimal rates for i.i.d.~processes.
Subjects: Probability (math.PR); Statistics Theory (math.ST)
MSC classes: 60E15, 60G10, 37D20, 60F10, 68T05, 62G08, 62M10
Cite as: arXiv:1501.03059 [math.PR]
  (or arXiv:1501.03059v1 [math.PR] for this version)

Submission history

From: Ingo Steinwart [view email]
[v1] Tue, 13 Jan 2015 16:04:23 GMT (40kb)

Link back to: arXiv, form interface, contact.