Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Once-for-All Sequence Compression for Self-Supervised Speech Models
(Submitted on 4 Nov 2022 (v1), revised 3 Jan 2023 (this version, v2), latest version 9 May 2023 (v4))
Abstract: The sequence length along the time axis is often the dominant factor of the computational cost of self-supervised speech models. Works have been proposed to reduce the sequence length for lowering the computational cost. However, different downstream tasks have different tolerance of sequence compressing, so a model that produces a fixed compressing rate may not fit all tasks. In this work, we introduce a once-for-all (OFA) sequence compression framework for self-supervised speech models that supports a continuous range of compressing rates. The framework is evaluated on various tasks, showing marginal degradation compared to the fixed compressing rate variants with a smooth performance-efficiency trade-off. We further explore adaptive compressing rate learning, demonstrating the ability to select task-specific preferred frame periods without needing a grid search.
Submission history
From: Hsuan-Jui Chen [view email][v1] Fri, 4 Nov 2022 09:19:13 GMT (2196kb,D)
[v2] Tue, 3 Jan 2023 07:55:33 GMT (2749kb,D)
[v3] Wed, 15 Mar 2023 07:07:24 GMT (2237kb,D)
[v4] Tue, 9 May 2023 11:14:52 GMT (2233kb,D)
Link back to: arXiv, form interface, contact.