Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Production federated keyword spotting via distillation, filtering, and joint federated-centralized training
(Submitted on 11 Apr 2022 (v1), last revised 29 Jun 2022 (this version, v2))
Abstract: We trained a keyword spotting model using federated learning on real user devices and observed significant improvements when the model was deployed for inference on phones. To compensate for data domains that are missing from on-device training caches, we employed joint federated-centralized training. And to learn in the absence of curated labels on-device, we formulated a confidence filtering strategy based on user-feedback signals for federated distillation. These techniques created models that significantly improved quality metrics in offline evaluations and user-experience metrics in live A/B experiments.
Submission history
From: Andrew Hard [view email][v1] Mon, 11 Apr 2022 18:16:41 GMT (82kb,D)
[v2] Wed, 29 Jun 2022 21:03:59 GMT (83kb,D)
Link back to: arXiv, form interface, contact.