References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Bootstrapping Multi-view Representations for Fake News Detection
(Submitted on 12 Jun 2022 (v1), last revised 22 Sep 2022 (this version, v3))
Abstract: Previous researches on multimedia fake news detection include a series of complex feature extraction and fusion networks to gather useful information from the news. However, how cross-modal consistency relates to the fidelity of news and how features from different modalities affect the decision-making are still open questions. This paper presents a novel scheme of Bootstrapping Multi-view Representations (BMR) for fake news detection. Given a multi-modal news, we extract representations respectively from the views of the text, the image pattern and the image semantics. Improved Multi-gate Mixture-of-Expert networks (iMMoE) are proposed for feature refinement and fusion. Representations from each view are separately used to coarsely predict the fidelity of the whole news, and the multimodal representations are able to predict the cross-modal consistency. With the prediction scores, we reweigh each view of the representations and bootstrap them for fake news detection. Extensive experiments conducted on typical fake news detection datasets prove that the proposed BMR outperforms state-of-the-art schemes.
Submission history
From: Qichao Ying [view email][v1] Sun, 12 Jun 2022 14:06:55 GMT (2699kb,D)
[v2] Mon, 8 Aug 2022 02:17:42 GMT (0kb,I)
[v3] Thu, 22 Sep 2022 10:22:27 GMT (11486kb,D)
Link back to: arXiv, form interface, contact.