[Colloquium] REMINDER: 3/10 Research at TTIC: Kevin Gimpel, TTIC

[Mary Marre via Colloquium]

When:     Friday, March 10th at noon



Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526



Who:       Kevin Gimpel; TTIC



Title: Learning Paraphrastic Representations of Natural Language

Abstract:
I will discuss our experience in learning vector representations of
sentences that reflect paraphrastic similarity. That is, if two sentences
have similar meanings their vectors should have high cosine similarity. Our
goal is to produce a function that can be used to embed any sentence for
use in downstream tasks, analogous to how pretrained word embeddings are
currently used by practitioners in a broad range of applications. I'll
describe our experiments in which we train on large datasets of noisy
paraphrase pairs and test our models on standard semantic similarity
benchmarks. We consider a variety of functional architectures, including
those based on averaging, long short-term memory, and convolutional
networks. We find that simple architectures are easier to train and exhibit
more stability when transferring to new domains, though they can be beaten
by more powerful architectures when sufficient tuning and aggressive
regularization are used.

This is joint work with John Wieting, Mohit Bansal, and Karen Livescu.



****************************************************************************************

*Research at TTIC Seminar Series*

TTIC is hosting a weekly seminar series presenting the research currently
underway at the Institute. Every week a different TTIC faculty member will
present their research.  The lectures are intended both for students
seeking research topics and adviser, and for the general TTIC and
University of Chicago communities interested in hearing what their
colleagues are up to.

To receive announcements about the seminar series, please subscribe to the
mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe

Speaker details can be found at: http://www.ttic.edu/tticseminar.php.

For additional questions, please contact Nathan Srebro at nati at ttic.edu
<mcallester at ttic.edu>



Mary C. Marre
Administrative Assistant
*Toyota Technological Institute*
*6045 S. Kenwood Avenue*
*Room 504*
*Chicago, IL  60637*
*p:(773) 834-1757*
*f: (773) 357-6970*
*mmarre at ttic.edu <mmarre at ttic.edu>*

On Thu, Mar 9, 2017 at 12:48 PM, Mary Marre <mmarre at ttic.edu> wrote:

> When:     Friday, March 10th at noon
>
>
>
> Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526
>
>
>
> Who:       Kevin Gimpel; TTIC
>
>
>
> Title: Learning Paraphrastic Representations of Natural Language
>
> Abstract:
> I will discuss our experience in learning vector representations of
> sentences that reflect paraphrastic similarity. That is, if two sentences
> have similar meanings their vectors should have high cosine similarity. Our
> goal is to produce a function that can be used to embed any sentence for
> use in downstream tasks, analogous to how pretrained word embeddings are
> currently used by practitioners in a broad range of applications. I'll
> describe our experiments in which we train on large datasets of noisy
> paraphrase pairs and test our models on standard semantic similarity
> benchmarks. We consider a variety of functional architectures, including
> those based on averaging, long short-term memory, and convolutional
> networks. We find that simple architectures are easier to train and exhibit
> more stability when transferring to new domains, though they can be beaten
> by more powerful architectures when sufficient tuning and aggressive
> regularization are used.
>
> This is joint work with John Wieting, Mohit Bansal, and Karen Livescu.
>
>
>
>
> ****************************************************************************************
>
> *Research at TTIC Seminar Series*
>
> TTIC is hosting a weekly seminar series presenting the research currently
> underway at the Institute. Every week a different TTIC faculty member will
> present their research.  The lectures are intended both for students
> seeking research topics and adviser, and for the general TTIC and
> University of Chicago communities interested in hearing what their
> colleagues are up to.
>
> To receive announcements about the seminar series, please subscribe to the
> mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe
>
> Speaker details can be found at: http://www.ttic.edu/tticseminar.php.
>
> For additional questions, please contact Nathan Srebro at nati at ttic.edu
> <mcallester at ttic.edu>
>
>
>
>
>
> Mary C. Marre
> Administrative Assistant
> *Toyota Technological Institute*
> *6045 S. Kenwood Avenue*
> *Room 504*
> *Chicago, IL  60637*
> *p:(773) 834-1757 <(773)%20834-1757>*
> *f: (773) 357-6970 <(773)%20357-6970>*
> *mmarre at ttic.edu <mmarre at ttic.edu>*
>
> On Sat, Mar 4, 2017 at 4:43 PM, Mary Marre <mmarre at ttic.edu> wrote:
>
>> When:     Friday, March 10th at noon
>>
>>
>>
>> Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526
>>
>>
>>
>> Who:       Kevin Gimpel; TTIC
>>
>>
>>
>> Title: Learning Paraphrastic Representations of Natural Language
>>
>> Abstract:
>> I will discuss our experience in learning vector representations of
>> sentences that reflect paraphrastic similarity. That is, if two sentences
>> have similar meanings their vectors should have high cosine similarity. Our
>> goal is to produce a function that can be used to embed any sentence for
>> use in downstream tasks, analogous to how pretrained word embeddings are
>> currently used by practitioners in a broad range of applications. I'll
>> describe our experiments in which we train on large datasets of noisy
>> paraphrase pairs and test our models on standard semantic similarity
>> benchmarks. We consider a variety of functional architectures, including
>> those based on averaging, long short-term memory, and convolutional
>> networks. We find that simple architectures are easier to train and exhibit
>> more stability when transferring to new domains, though they can be beaten
>> by more powerful architectures when sufficient tuning and aggressive
>> regularization are used.
>>
>> This is joint work with John Wieting, Mohit Bansal, and Karen Livescu.
>>
>>
>> ****************************************************************************************
>>
>> *Research at TTIC Seminar Series*
>>
>> TTIC is hosting a weekly seminar series presenting the research currently
>> underway at the Institute. Every week a different TTIC faculty member will
>> present their research.  The lectures are intended both for students
>> seeking research topics and adviser, and for the general TTIC and
>> University of Chicago communities interested in hearing what their
>> colleagues are up to.
>>
>> To receive announcements about the seminar series, please subscribe to
>> the mailing list: https://groups.google.com/a/ttic.edu/group/talks/subsc
>> ribe
>>
>> Speaker details can be found at: http://www.ttic.edu/tticseminar.php.
>>
>> For additional questions, please contact Nathan Srebro at nati at ttic.edu
>> <mcallester at ttic.edu>
>>
>>
>> Mary C. Marre
>> Administrative Assistant
>> *Toyota Technological Institute*
>> *6045 S. Kenwood Avenue*
>> *Room 504*
>> *Chicago, IL  60637*
>> *p:(773) 834-1757 <(773)%20834-1757>*
>> *f: (773) 357-6970 <(773)%20357-6970>*
>> *mmarre at ttic.edu <mmarre at ttic.edu>*
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20170310/4027bc45/attachment-0001.html>