We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Robust Training of Social Media Image Classification Models for Rapid Disaster Response

Abstract: Images shared on social media help crisis managers gain situational awareness and assess incurred damages, among other response tasks. As the volume and velocity of such content are typically high, real-time image classification has become an urgent need for a faster disaster response. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification for a number of tasks, including detecting crisis incidents, filtering irrelevant images, classifying images into specific humanitarian categories, and assessing the severity of the damage. To develop robust real-time models, it is necessary to understand the capability of the publicly available pre-trained models for these tasks, which remains to be under-explored in the crisis informatics literature. In this study, we address such limitations by investigating ten different network architectures for four different tasks using the largest publicly available datasets for these tasks. We also explore various data augmentation strategies, semi-supervised techniques, and a multitask learning setup. In our extensive experiments, we achieve promising results.
Comments: Social media images, Image Classification, Natural disasters, Crisis Informatics, Deep learning. Extended version of arXiv:2011.08916. arXiv admin note: substantial text overlap with arXiv:2011.08916
Subjects: Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI)
MSC classes: 68T50
ACM classes: I.2.7
Cite as: arXiv:2104.04184 [cs.CV]
  (or arXiv:2104.04184v2 [cs.CV] for this version)

Submission history

From: Firoj Alam [view email]
[v1] Fri, 9 Apr 2021 04:30:04 GMT (7599kb,D)
[v2] Mon, 19 Jul 2021 12:56:08 GMT (8315kb,D)

Link back to: arXiv, form interface, contact.