We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Adversarially Robust Kernel Smoothing

Abstract: We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the Wasserstein distance and the maximum mean discrepancy. We adapt the integral operator using supremal convolution in convex analysis to form a novel function majorant used for enforcing robustness. Our method is simple in form and applies to general loss functions and machine learning models. Exploiting a connection with optimal transport, we prove theoretical guarantees for certified robustness under distribution shift. Furthermore, we report experiments with general machine learning models, such as deep neural networks, to demonstrate competitive performance with the state-of-the-art certifiable robust learning algorithms based on the Wasserstein distance.
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:2102.08474 [cs.LG]
  (or arXiv:2102.08474v4 [cs.LG] for this version)

Submission history

From: Jia-Jie Zhu [view email]
[v1] Tue, 16 Feb 2021 22:25:18 GMT (220kb,D)
[v2] Thu, 4 Mar 2021 13:12:12 GMT (220kb,D)
[v3] Sun, 4 Jul 2021 16:23:31 GMT (342kb,D)
[v4] Sat, 19 Feb 2022 10:37:52 GMT (7302kb,D)

Link back to: arXiv, form interface, contact.