Skip to content
CaMLSysUniversity of Cambridge
Home People Publications Projects Contact

← All publications

Mic2Mic: Using Cycle-Consistent Generative Adversarial Networks to Overcome Microphone Variability in Speech Systems

  • Akhil MathurNokia Bell LabsUniversity College London
  • Anton IsopoussuNokia Bell Labs
  • Fahim KawsarNokia Bell Labs
  • Nadia BerthouzeUniversity College London
  • Nicholas D. LaneUniversity of Oxford

ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), 2019

Abstract

Mobile and embedded devices are increasingly using microphones and audio-based computational models to infer user context. A major challenge in building systems that combine audio models with commodity microphones is to guarantee their accuracy and robustness in the real-world. Besides many environmental dynamics, a primary factor that impacts the robustness of audio models is microphone variability. In this work, we propose Mic2Mic – a machine-learned system component – which resides in the inference pipeline of audio models and at real-time reduces the variability in audio data caused by microphone-specific factors. Two key considerations for the design of Mic2Mic were: a) to decouple the problem of microphone variability from the audio task, and b) put a minimal burden on end-users to provide training data. With these in mind, we apply the principles of cycle-consistent generative adversarial networks (CycleGANs) to learn Mic2Mic using unlabeled and unpaired data collected from different microphones. Our experiments show that Mic2Mic can recover between 66% to 89% of the accuracy lost due to microphone variability for two common audio tasks.

Materials

  • PDF
BibTeX
@inproceedings{mathur2019mic2mic,
  title = {{Mic2Mic: Using Cycle-Consistent Generative Adversarial Networks to Overcome Microphone Variability in Speech Systems}},
  author = {Mathur, Akhil and Isopoussu, Anton and Kawsar, Fahim and Berthouze, Nadia and Lane, Nicholas D.},
  year = {2019},
  booktitle = {ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)}
}
Cambridge Machine Learning Systems Group
Department of Computer Science and Technology
University of Cambridge
ContactGitHub