We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Exploring Adversarial Examples for Efficient Active Learning in Machine Learning Classifiers

Abstract: Machine learning researchers have long noticed the phenomenon that the model training process will be more effective and efficient when the training samples are densely sampled around the underlying decision boundary. While this observation has already been widely applied in a range of machine learning security techniques, it lacks theoretical analyses of the correctness of the observation. To address this challenge, we first add particular perturbation to original training examples using adversarial attack methods so that the generated examples could lie approximately on the decision boundary of the ML classifiers. We then investigate the connections between active learning and these particular training examples. Through analyzing various representative classifiers such as k-NN classifiers, kernel methods as well as deep neural networks, we establish a theoretical foundation for the observation. As a result, our theoretical proofs provide support to more efficient active learning methods with the help of adversarial examples, contrary to previous works where adversarial examples are often used as destructive solutions. Experimental results show that the established theoretical foundation will guide better active learning strategies based on adversarial examples.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2109.10770 [cs.LG]
  (or arXiv:2109.10770v2 [cs.LG] for this version)

Submission history

From: Honggang Yu [view email]
[v1] Wed, 22 Sep 2021 14:51:26 GMT (4407kb)
[v2] Thu, 23 Sep 2021 04:08:59 GMT (4300kb)

Link back to: arXiv, form interface, contact.