We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Abstract: Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance. To this end, we have applied explainable artificial intelligence (XAI) methods in remote sensing multi-label classification tasks towards producing human-interpretable explanations and improve transparency. In particular, we utilized and trained deep learning models with state-of-the-art performance in the benchmark BigEarthNet and SEN12MS datasets. Ten XAI methods were employed towards understanding and interpreting models' predictions, along with quantitative metrics to assess and compare their performance. Numerous experiments were performed to assess the overall performance of XAI methods for straightforward prediction cases, competing multiple labels, as well as misclassification cases. According to our findings, Occlusion, Grad-CAM and Lime were the most interpretable and reliable XAI methods. However, none delivers high-resolution outputs, while apart from Grad-CAM, both Lime and Occlusion are computationally expensive. We also highlight different aspects of XAI performance and elaborate with insights on black-box decisions in order to improve transparency, understand their behavior and reveal, as well, datasets' particularities.
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Journal reference: International Journal of Applied Earth Observation and Geoinformation 103 (2021) 102520
DOI: 10.1016/j.jag.2021.102520
Cite as: arXiv:2104.01375 [cs.LG]
  (or arXiv:2104.01375v2 [cs.LG] for this version)

Submission history

From: Ioannis Kakogeorgiou [view email]
[v1] Sat, 3 Apr 2021 11:13:14 GMT (3482kb)
[v2] Mon, 20 Sep 2021 11:04:15 GMT (2507kb)

Link back to: arXiv, form interface, contact.