Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: E-Branchformer: Branchformer with Enhanced merging for speech recognition
(Submitted on 30 Sep 2022 (v1), last revised 14 Oct 2022 (this version, v2))
Abstract: Conformer, combining convolution and self-attention sequentially to capture both local and global information, has shown remarkable performance and is currently regarded as the state-of-the-art for automatic speech recognition (ASR). Several other studies have explored integrating convolution and self-attention but they have not managed to match Conformer's performance. The recently introduced Branchformer achieves comparable performance to Conformer by using dedicated branches of convolution and self-attention and merging local and global context from each branch. In this paper, we propose E-Branchformer, which enhances Branchformer by applying an effective merging method and stacking additional point-wise modules. E-Branchformer sets new state-of-the-art word error rates (WERs) 1.81% and 3.65% on LibriSpeech test-clean and test-other sets without using any external training data.
Submission history
From: Kwangyoun Kim [view email][v1] Fri, 30 Sep 2022 20:22:15 GMT (535kb,D)
[v2] Fri, 14 Oct 2022 22:14:59 GMT (536kb,D)
Link back to: arXiv, form interface, contact.