References & Citations
Computer Science > Computation and Language
Title: INSET: Sentence Infilling with INter-SEntential Transformer
(Submitted on 10 Nov 2019 (v1), last revised 4 Jun 2020 (this version, v2))
Abstract: Missing sentence generation (or sentence infilling) fosters a wide range of applications in natural language generation, such as document auto-completion and meeting note expansion. This task asks the model to generate intermediate missing sentences that can syntactically and semantically bridge the surrounding context. Solving the sentence infilling task requires techniques in natural language processing ranging from understanding to discourse-level planning to generation. In this paper, we propose a framework to decouple the challenge and address these three aspects respectively, leveraging the power of existing large-scale pre-trained models such as BERT and GPT-2. We empirically demonstrate the effectiveness of our model in learning a sentence representation for generation and further generating a missing sentence that fits the context.
Submission history
From: Yichen Huang [view email][v1] Sun, 10 Nov 2019 10:41:52 GMT (77kb,D)
[v2] Thu, 4 Jun 2020 22:54:51 GMT (81kb,D)
Link back to: arXiv, form interface, contact.