References & Citations
Computer Science > Computation and Language
Title: Contrastive Multi-document Question Generation
(Submitted on 8 Nov 2019 (v1), last revised 18 May 2021 (this version, v3))
Abstract: Multi-document question generation focuses on generating a question that covers the common aspect of multiple documents. Such a model is useful in generating clarifying options. However, a naive model trained only using the targeted ("positive") document set may generate too generic questions that cover a larger scope than delineated by the document set. To address this challenge, we introduce the contrastive learning strategy where given "positive" and "negative" sets of documents, we generate a question that is closely related to the "positive" set but is far away from the "negative" set. This setting allows generated questions to be more specific and related to the target document set. To generate such specific questions, we propose Multi-Source Coordinated Question Generator (MSCQG), a novel framework that includes a supervised learning (SL) stage and a reinforcement learning (RL) stage. In the SL stage, a single-document question generator is trained. In the RL stage, a coordinator model is trained to find optimal attention weights to align multiple single-document generators, by optimizing a reward designed to promote specificity of generated questions. We also develop an effective auxiliary objective, named Set-induced Contrastive Regularization (SCR) that improves the coordinator's contrastive learning during the RL stage. We show that our model significantly outperforms several strong baselines, as measured by automatic metrics and human evaluation. The source repository is publicly available at \url{www.github.com/woonsangcho/contrast_qgen}.
Submission history
From: Woon Sang Cho [view email][v1] Fri, 8 Nov 2019 04:45:55 GMT (7819kb,D)
[v2] Wed, 29 Apr 2020 13:16:57 GMT (7495kb,D)
[v3] Tue, 18 May 2021 11:36:50 GMT (7094kb,D)
Link back to: arXiv, form interface, contact.