[Colloquium] [Talks at TTIC] 1/17 Research at TTIC: David Chiang, TTIC

[Jerome Allen]

 *When:*     Friday, January 17th.  *Refreshments at 12:00pm. *
*Talk at 12:20pm. *

*Where:*    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526

*Who: *      David Chiang, TTIC

*Title:       *Representing Unordered Data Using Multiset Automata

*Abstract: * Unordered, variable-sized inputs arise in many settings across
multiple fields. The ability for set- and multiset- oriented neural
networks to handle this type of input has been the focus of much work in
recent years. We propose to represent multisets using complex-weighted
multiset automata. Multiset automata (also known as commutative automata)
are a class of automata for which the symbols can be read in any order and
obtain the same result. I will talk about algorithms for converting
weighted multiset automata to and from weighted commutative regular
expressions, for computing inside weights, and for training weighted
multiset automata from data. Finally, I will show how the
multiset representations of certain existing neural architectures can be
viewed as special cases of ours. Namely, (1) we provide a new theoretical
and intuitive justification for the Transformer model's representation of
positions using sinusoidal functions, and (2) we extend the DeepSets model
to use complex numbers, enabling it to outperform the existing model on an
extension of one of their tasks.

This talk presents work done with Justin DeBenedetto.
********************************************************************************************************

*Research at TTIC Seminar Series*

TTIC is hosting a weekly seminar series presenting the research currently
underway at the Institute. Every week a different TTIC faculty member will
present their research.  The lectures are intended both for students
seeking research topics and adviser, and for the general TTIC and
University of Chicago communities interested in hearing what their
colleagues are up to.

To receive announcements about the seminar series, please subscribe to the
mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe

Speaker details can be found at: http://www.ttic.edu/tticseminar.php.

For additional questions, please contact Nathan Srebro at nati at ttic.edu
<mcallester at ttic.edu>.
*Jerome Allen*
Executive Assistant
*Toyota Technological Institute*
6045 S. Kenwood Avenue
Room 518
Chicago, IL  60637
p:(773) 702-2311
*jallen at ttic.edu <jallen at ttic.edu>*


On Thu, Jan 16, 2020 at 12:55 PM Jerome Allen <jallen at ttic.edu> wrote:

> *When:*     Friday, January 17th.  *Refreshments at 12:00pm. *
> *Talk at 12:20pm. *
>
> *Where:*    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526
>
> *Who: *      David Chiang, TTIC
>
> *Title:       *Representing Unordered Data Using Multiset Automata
>
> *Abstract: * Unordered, variable-sized inputs arise in many settings
> across multiple fields. The ability for set- and multiset- oriented neural
> networks to handle this type of input has been the focus of much work in
> recent years. We propose to represent multisets using complex-weighted
> multiset automata. Multiset automata (also known as commutative automata)
> are a class of automata for which the symbols can be read in any order and
> obtain the same result. I will talk about algorithms for converting
> weighted multiset automata to and from weighted commutative regular
> expressions, for computing inside weights, and for training weighted
> multiset automata from data. Finally, I will show how the
> multiset representations of certain existing neural architectures can be
> viewed as special cases of ours. Namely, (1) we provide a new theoretical
> and intuitive justification for the Transformer model's representation of
> positions using sinusoidal functions, and (2) we extend the DeepSets model
> to use complex numbers, enabling it to outperform the existing model on an
> extension of one of their tasks.
>
> This talk presents work done with Justin DeBenedetto.
>
> ********************************************************************************************************
>
> *Research at TTIC Seminar Series*
>
> TTIC is hosting a weekly seminar series presenting the research currently
> underway at the Institute. Every week a different TTIC faculty member will
> present their research.  The lectures are intended both for students
> seeking research topics and adviser, and for the general TTIC and
> University of Chicago communities interested in hearing what their
> colleagues are up to.
>
> To receive announcements about the seminar series, please subscribe to the
> mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe
>
> Speaker details can be found at: http://www.ttic.edu/tticseminar.php.
>
> For additional questions, please contact Nathan Srebro at nati at ttic.edu
> <mcallester at ttic.edu>.
> *Jerome Allen*
> Executive Assistant
> *Toyota Technological Institute*
> 6045 S. Kenwood Avenue
> Room 518
> Chicago, IL  60637
> p:(773) 702-2311
> *jallen at ttic.edu <jallen at ttic.edu>*
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20200117/1b4b126e/attachment-0001.html>