We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Artificial Intelligence

Title: On Guaranteed Optimal Robust Explanations for NLP Models

Abstract: We build on abduction-based explanations for ma-chine learning and develop a method for computing local explanations for neural network models in natural language processing (NLP). Our explanations comprise a subset of the words of the in-put text that satisfies two key features: optimality w.r.t. a user-defined cost function, such as the length of explanation, and robustness, in that they ensure prediction invariance for any bounded perturbation in the embedding space of the left out words. We present two solution algorithms, respectively based on implicit hitting sets and maximum universal subsets, introducing a number of algorithmic improvements to speed up convergence of hard instances. We show how our method can be con-figured with different perturbation sets in the em-bedded space and used to detect bias in predictions by enforcing include/exclude constraints on biased terms, as well as to enhance existing heuristic-based NLP explanation frameworks such as Anchors. We evaluate our framework on three widely used sentiment analysis tasks and texts of up to100words from SST, Twitter and IMDB datasets,demonstrating the effectiveness of the derived explanations.
Comments: 13 pages (8+5 Appendix). Accepted as long-paper at IJCAI 2021
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Journal reference: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence 2021
DOI: 10.24963/366
Report number: Pages 2658-2665
Cite as: arXiv:2105.03640 [cs.AI]
  (or arXiv:2105.03640v2 [cs.AI] for this version)

Submission history

From: Emanuele La Malfa [view email]
[v1] Sat, 8 May 2021 08:44:48 GMT (3095kb,D)
[v2] Fri, 14 May 2021 08:41:57 GMT (3097kb,D)

Link back to: arXiv, form interface, contact.