[Colloquium] REMINDER: 3/28 Young Researcher Seminar Series: Andrew Owens, UC Berkeley

[Mary Marre via Colloquium]

 When:     Wednesday, March 28th at *10:30 am*

Where:    TTIC, 6045 S. Kenwood Avenue, 5th Floor, Room 526

Who:       Andrew Owens, UC Berkeley


Title:        Learning Sight from Sound

Abstract:
>From the clink of a mug placed onto a saucer to the bustle of a busy cafe,
our days are filled with visual experiences that are accompanied by
distinctive sounds.  In this talk, we show that these sounds can provide a
rich training signal for learning visual models.  First, we propose the
task of predicting what sound an object makes when struck as a way of
studying physical interactions within a visual scene.  We demonstrate this
idea by training an algorithm to produce plausible soundtracks for videos
in which people hit and scratch objects with a drumstick.  Second, we show
that ambient audio -- e.g., crashing waves, people speaking in a crowd --
can also be used to learn visual models.  We train a convolutional neural
network to predict a statistical summary of the sounds that occur within a
scene, and we demonstrate that the learned visual representation conveys
information about objects and scenes. Finally, we present an unsupervised
learning method for training multi-modal networks that fuse audio and
visual data, and apply the learned representation to a number of
audio-visual learning tasks.



Host: Greg Shakhnarovich <greg at ttic.edu>

************************************************************
**************************************



The TTIC Young Researcher Seminar Series (http://www.ttic.edu/young-
researcher.php) features talks by Ph.D. students and postdocs whose research is
of broad interest to the computer science community. The series provides an
opportunity for early-career researchers to present recent work to and meet
with students and faculty at TTIC and nearby universities.


The seminars are typically held on Wednesdays at 11:00am in TTIC Room 526.

For additional information, please contact Matthew Walter (mwalter at ttic.edu
).





Mary C. Marre
Administrative Assistant
*Toyota Technological Institute*
*6045 S. Kenwood Avenue*
*Room 504*
*Chicago, IL  60637*
*p:(773) 834-1757*
*f: (773) 357-6970*
*mmarre at ttic.edu <mmarre at ttic.edu>*

On Wed, Mar 21, 2018 at 4:10 PM, Mary Marre <mmarre at ttic.edu> wrote:

> When:     Wednesday, March 28th at *10:30 am*
>
> Where:    TTIC, 6045 S. Kenwood Avenue, 5th Floor, Room 526
>
> Who:       Andrew Owens, UC Berkeley
>
> Title:        Learning Sight from Sound
>
> Abstract:
> From the clink of a mug placed onto a saucer to the bustle of a busy cafe,
> our days are filled with visual experiences that are accompanied by
> distinctive sounds.  In this talk, we show that these sounds can provide a
> rich training signal for learning visual models.  First, we propose the
> task of predicting what sound an object makes when struck as a way of
> studying physical interactions within a visual scene.  We demonstrate this
> idea by training an algorithm to produce plausible soundtracks for videos
> in which people hit and scratch objects with a drumstick.  Second, we show
> that ambient audio -- e.g., crashing waves, people speaking in a crowd --
> can also be used to learn visual models.  We train a convolutional neural
> network to predict a statistical summary of the sounds that occur within a
> scene, and we demonstrate that the learned visual representation conveys
> information about objects and scenes. Finally, we present an unsupervised
> learning method for training multi-modal networks that fuse audio and
> visual data, and apply the learned representation to a number of
> audio-visual learning tasks.
>
>
>
> Host: Greg Shakhnarovich <greg at ttic.edu>
>
> ************************************************************
> **************************************
>
>
>
> The TTIC Young Researcher Seminar Series (http://www.ttic.edu/young-
> researcher.php) features talks by Ph.D. students and postdocs whose
> research is of broad interest to the computer science community. The
> series provides an opportunity for early-career researchers to present
> recent work to and meet with students and faculty at TTIC and nearby
> universities.
>
>
> The seminars are typically held on Wednesdays at 11:00am in TTIC Room 526.
>
> For additional information, please contact Matthew Walter (
> mwalter at ttic.edu).
>
>
>
>
>
>
> Mary C. Marre
> Administrative Assistant
> *Toyota Technological Institute*
> *6045 S. Kenwood Avenue*
> *Room 504*
> *Chicago, IL  60637*
> *p:(773) 834-1757 <(773)%20834-1757>*
> *f: (773) 357-6970 <(773)%20357-6970>*
> *mmarre at ttic.edu <mmarre at ttic.edu>*
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20180327/c2bbd0ea/attachment-0001.html>