[Colloquium] 11/5 TTIC Colloquium: Shinji Watanabe, Johns Hopkins University

[Mary Marre via Colloquium]

*When:    *  Monday, November 5th at 11:00 am

*Where:     *TTIC, 6045 S. Kenwood Avenue, 5th Floor, Room 526



*Who:        *Shinji Watanabe, Johns Hopkins University



*Title: *        Multichannel End-to-End Speech Recognition

*Abstract:*
The field of speech recognition is in the midst of a paradigm shift:
end-to-end neural networks are challenging the dominance of hidden Markov
models as a core technology. Using an attention mechanism in a recurrent
encoder-decoder architecture solves the dynamic time alignment problem,
allowing joint end-to-end training of the acoustic and language modeling
components. In this talk we extend the end-to-end framework to encompass
microphone array signal processing for noise suppression and
speech enhancement within the acoustic encoding network. This allows the
beamforming components to be optimized jointly within the recognition
architecture to improve the end-to-end speech recognition objective.
Experiments on the noisy speech benchmarks (CHiME-4 and AMI) show that our
multichannel end-to-end system outperformed the attention-based baseline
with input from a conventional adaptive beamformer. In addition, the talk
covers further analysis of whether the integrated end-to-end
architecture successfully obtains adequate speech enhancement ability that
is superior to that of a conventional alternative (a delay-and-sum
beamformer) by observing two signal-level measures: the
signal-to-distortion ratio and the perceptual evaluation of speech
quality. The talk also introduces a multi-path adaptation scheme for
end-to-end multichannel ASR, which combines the unprocessed noisy speech
features with a speech-enhanced pathway to improve upon previous end-to-end
ASR approaches.

Host: Karen Livescu <klivescu at ttic.edu>

For more information on the colloquium series or to subscribe to the
mailing list, please see http://www.ttic.edu/colloquium.php




Mary C. Marre
Administrative Assistant
*Toyota Technological Institute*
*6045 S. Kenwood Avenue*
*Room 517*
*Chicago, IL  60637*
*p:(773) 834-1757*
*f: (773) 357-6970*
*mmarre at ttic.edu <mmarre at ttic.edu>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20181029/dd75829c/attachment-0001.html>