References & Citations
Computer Science > Computation and Language
Title: Long Text Generation Challenge
(Submitted on 4 Jun 2023)
Abstract: We propose a shared task of human-like long text generation, LTG Challenge, that asks models to output a consistent human-like long text (a Harry Potter generic audience fanfic in English), given a prompt of about 1000 tokens. We suggest a novel statistical metric of the text structuredness, GloVe Autocorrelations Power/ Exponential Law Mean Absolute Percentage Error Ratio (GAPELMAPER) and a human evaluation protocol. We hope that LTG can open new avenues for researchers to investigate sampling approaches, prompting strategies, autoregressive and non-autoregressive text generation architectures and break the barrier to generate consistent long (40K+ token) texts.
Submission history
From: Nikolay Mikhaylovskiy [view email][v1] Sun, 4 Jun 2023 11:52:36 GMT (773kb)
Link back to: arXiv, form interface, contact.