References & Citations
Computer Science > Computation and Language
Title: Average Token Delay: A Latency Metric for Simultaneous Translation
(Submitted on 22 Nov 2022 (v1), last revised 9 Feb 2023 (this version, v2))
Abstract: Simultaneous translation is a task in which translation begins before the speaker has finished speaking. In its evaluation, we have to consider the latency of the translation in addition to the quality. The latency is preferably as small as possible for users to comprehend what the speaker says with a small delay. Existing latency metrics focus on when the translation starts but do not consider adequately when the translation ends. This means such metrics do not penalize the latency caused by a long translation output, which actually delays users' comprehension. In this work, we propose a novel latency evaluation metric called Average Token Delay (ATD) that focuses on the end timings of partial translations in simultaneous translation. We discuss the advantage of ATD using simulated examples and also investigate the differences between ATD and Average Lagging with simultaneous translation experiments.
Submission history
From: Yasumasa Kano [view email][v1] Tue, 22 Nov 2022 06:45:13 GMT (7016kb,D)
[v2] Thu, 9 Feb 2023 03:45:41 GMT (7089kb,D)
Link back to: arXiv, form interface, contact.