We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Retrieval

Title: Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection

Abstract: Fake news often involves multimedia information such as text and image to mislead readers, proliferating and expanding its influence. Most existing fake news detection methods apply the co-attention mechanism to fuse multimodal features while ignoring the consistency of image and text in co-attention. In this paper, we propose multimodal matching-aware co-attention networks with mutual knowledge distillation for improving fake news detection. Specifically, we design an image-text matching-aware co-attention mechanism which captures the alignment of image and text for better multimodal fusion. The image-text matching representation can be obtained via a vision-language pre-trained model. Additionally, based on the designed image-text matching-aware co-attention mechanism, we propose to build two co-attention networks respectively centered on text and image for mutual knowledge distillation to improve fake news detection. Extensive experiments on three benchmark datasets demonstrate that our proposed model achieves state-of-the-art performance on multimodal fake news detection.
Subjects: Information Retrieval (cs.IR); Multimedia (cs.MM)
Cite as: arXiv:2212.05699 [cs.IR]
  (or arXiv:2212.05699v2 [cs.IR] for this version)

Submission history

From: Ziwang Zhao [view email]
[v1] Mon, 12 Dec 2022 04:36:06 GMT (2287kb,D)
[v2] Wed, 12 Apr 2023 05:31:36 GMT (990kb,D)

Link back to: arXiv, form interface, contact.