References & Citations
Computer Science > Information Retrieval
Title: Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection
(Submitted on 12 Dec 2022 (v1), last revised 12 Apr 2023 (this version, v2))
Abstract: Fake news often involves multimedia information such as text and image to mislead readers, proliferating and expanding its influence. Most existing fake news detection methods apply the co-attention mechanism to fuse multimodal features while ignoring the consistency of image and text in co-attention. In this paper, we propose multimodal matching-aware co-attention networks with mutual knowledge distillation for improving fake news detection. Specifically, we design an image-text matching-aware co-attention mechanism which captures the alignment of image and text for better multimodal fusion. The image-text matching representation can be obtained via a vision-language pre-trained model. Additionally, based on the designed image-text matching-aware co-attention mechanism, we propose to build two co-attention networks respectively centered on text and image for mutual knowledge distillation to improve fake news detection. Extensive experiments on three benchmark datasets demonstrate that our proposed model achieves state-of-the-art performance on multimodal fake news detection.
Submission history
From: Ziwang Zhao [view email][v1] Mon, 12 Dec 2022 04:36:06 GMT (2287kb,D)
[v2] Wed, 12 Apr 2023 05:31:36 GMT (990kb,D)
Link back to: arXiv, form interface, contact.