We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: An explainable deep vision system for animal classification and detection in trail-camera images with automatic post-deployment retraining

Authors: Golnaz Moallem (1), Don D. Pathirage (1), Joel Reznick (1), James Gallagher (2), Hamed Sari-Sarraf (1) ((1) Applied Vision Lab Texas Tech University (2) Texas Parks and Wildlife Department)
Abstract: This paper introduces an automated vision system for animal detection in trail-camera images taken from a field under the administration of the Texas Parks and Wildlife Department. As traditional wildlife counting techniques are intrusive and labor intensive to conduct, trail-camera imaging is a comparatively non-intrusive method for capturing wildlife activity. However, given the large volume of images produced from trail-cameras, manual analysis of the images remains time-consuming and inefficient. We implemented a two-stage deep convolutional neural network pipeline to find animal-containing images in the first stage and then process these images to detect birds in the second stage. The animal classification system classifies animal images with overall 93% sensitivity and 96% specificity. The bird detection system achieves better than 93% sensitivity, 92% specificity, and 68% average Intersection-over-Union rate. The entire pipeline processes an image in less than 0.5 seconds as opposed to an average 30 seconds for a human labeler. We also addressed post-deployment issues related to data drift for the animal classification system as image features vary with seasonal changes. This system utilizes an automatic retraining algorithm to detect data drift and update the system. We introduce a novel technique for detecting drifted images and triggering the retraining procedure. Two statistical experiments are also presented to explain the prediction behavior of the animal classification system. These experiments investigate the cues that steers the system towards a particular decision. Statistical hypothesis testing demonstrates that the presence of an animal in the input image significantly contributes to the system's decisions.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Journal reference: Knowledge-Based Systems, Volume 216, 15 March 2021, 106815
DOI: 10.1016/j.knosys.2021.106815
Cite as: arXiv:2010.11472 [cs.CV]
  (or arXiv:2010.11472v3 [cs.CV] for this version)

Submission history

From: Don Pathirage [view email]
[v1] Thu, 22 Oct 2020 06:29:55 GMT (3745kb)
[v2] Sat, 5 Dec 2020 01:42:12 GMT (3689kb)
[v3] Tue, 8 Dec 2020 02:17:00 GMT (3717kb)

Link back to: arXiv, form interface, contact.