Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Replacing Human Audio with Synthetic Audio for On-device Unspoken Punctuation Prediction
(Submitted on 20 Oct 2020 (v1), last revised 10 Feb 2021 (this version, v2))
Abstract: We present a novel multi-modal unspoken punctuation prediction system for the English language which combines acoustic and text features. We demonstrate for the first time, that by relying exclusively on synthetic data generated using a prosody-aware text-to-speech system, we can outperform a model trained with expensive human audio recordings on the unspoken punctuation prediction problem. Our model architecture is well suited for on-device use. This is achieved by leveraging hash-based embeddings of automatic speech recognition text output in conjunction with acoustic features as input to a quasi-recurrent neural network, keeping the model size small and latency low.
Submission history
From: Ondrej Skopek [view email][v1] Tue, 20 Oct 2020 11:30:26 GMT (67kb,D)
[v2] Wed, 10 Feb 2021 21:01:35 GMT (68kb,D)
Link back to: arXiv, form interface, contact.