[Colloquium] 1/13 Research at TTIC: Michael Maire, TTIC

[Mary Marre via Colloquium]

When:     Friday, January 13th at noon



Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526



Who:       Michael Maire; TTIC


Title: Fractal and Multigrid Architectures for Deep Neural Networks

Abstract:

Deep convolutional neural networks (CNNs) are central to modern computer
vision systems.  This talk covers two recent works, each connecting a
particular design pattern for network architecture to corresponding
learning capabilities.

The first explores repeated application of a simple expansion rule to
generate deep networks whose structural layouts are precisely truncated
fractals.  These networks match the state-of-the-art performance held by
residual networks on both CIFAR and ImageNet classification tasks, thereby
demonstrating that residual representations may not be fundamental to the
success of extremely deep networks.  Additionally, fractal networks can be
trained to exhibit an anytime property: shallow subnetworks provide a quick
answer, while deeper subnetworks, with higher latency, provide a more
accurate answer.

The second proposes a multigrid extension of CNNs.  Here, network layers
operate across scale space, consuming multigrid inputs and producing
multigrid outputs; convolutional filters themselves have both within-scale
and cross-scale extent.  Multigrid structure enables such networks to learn
internal attention and dynamic routing mechanisms, and use them to
accomplish tasks on which standard CNNs fail.


************************************************************
****************************************************

*Research at TTIC Seminar Series*

TTIC is hosting a weekly seminar series presenting the research currently
underway at the Institute. Every week a different TTIC faculty member will
present their research.  The lectures are intended both for students
seeking research topics and adviser, and for the general TTIC and
University of Chicago communities interested in hearing what their
colleagues are up to.

To receive announcements about the seminar series, please subscribe to the
mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe

Speaker details can be found at: http://www.ttic.edu/tticseminar.php.

For additional questions, please contact Nathan Srebro at nati at ttic.edu
<mcallester at ttic.edu>

Mary C. Marre
Administrative Assistant
*Toyota Technological Institute*
*6045 S. Kenwood Avenue*
*Room 504*
*Chicago, IL  60637*
*p:(773) 834-1757*
*f: (773) 357-6970*
*mmarre at ttic.edu <mmarre at ttic.edu>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20170110/5766ca07/attachment.html>