[Colloquium] REMINDER: 6/2 Research at TTIC: Suriya Gunasekar, TTIC

Mary Marre via Colloquium colloquium at mailman.cs.uchicago.edu
Fri Jun 2 11:26:20 CDT 2017


When:     Friday, June 2nd at noon



Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526



Who:       Suriya Gunasekar, TTIC


*Title:*       Implicit Regularization in Matrix Factorization

*Abstract:* This talk will explore ideas on "implicit regularization" in
underdetermined problems where the optimization objective has multiple
global minima. We specifically study optimization of a quadratic loss over
a matrix with gradient descent on the factorized space. We conjecture and
provide empirical and theoretical evidence that with small enough step
sizes and initialization close enough to the origin, gradient descent on a
full dimensional factorization converges to the minimum nuclear norm
solution.


********************************************************************************************************

*Research at TTIC Seminar Series*

TTIC is hosting a weekly seminar series presenting the research currently
underway at the Institute. Every week a different TTIC faculty member will
present their research.  The lectures are intended both for students
seeking research topics and adviser, and for the general TTIC and
University of Chicago communities interested in hearing what their
colleagues are up to.

To receive announcements about the seminar series, please subscribe to the
mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe

Speaker details can be found at: http://www.ttic.edu/tticseminar.php.

For additional questions, please contact Nathan Srebro at nati at ttic.edu
<mcallester at ttic.edu>



Mary C. Marre
Administrative Assistant
*Toyota Technological Institute*
*6045 S. Kenwood Avenue*
*Room 504*
*Chicago, IL  60637*
*p:(773) 834-1757*
*f: (773) 357-6970*
*mmarre at ttic.edu <mmarre at ttic.edu>*

On Thu, Jun 1, 2017 at 12:31 PM, Mary Marre <mmarre at ttic.edu> wrote:

> When:     Friday, June 2nd at noon
>
>
>
> Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526
>
>
>
> Who:       Suriya Gunasekar, TTIC
>
>
> *Title:*       Implicit Regularization in Matrix Factorization
>
> *Abstract:* This talk will explore ideas on "implicit regularization" in
> underdetermined problems where the optimization objective has multiple
> global minima. We specifically study optimization of a quadratic loss over
> a matrix with gradient descent on the factorized space. We conjecture and
> provide empirical and theoretical evidence that with small enough step
> sizes and initialization close enough to the origin, gradient descent on a
> full dimensional factorization converges to the minimum nuclear norm
> solution.
>
>
>
> ********************************************************************************************************
>
> *Research at TTIC Seminar Series*
>
> TTIC is hosting a weekly seminar series presenting the research currently
> underway at the Institute. Every week a different TTIC faculty member
> will present their research.  The lectures are intended both for students
> seeking research topics and adviser, and for the general TTIC and
> University of Chicago communities interested in hearing what their
> colleagues are up to.
>
> To receive announcements about the seminar series, please subscribe to the
> mailing list: https://groups.google.com/a/ttic.edu/group/talks/subscribe
>
> Speaker details can be found at: http://www.ttic.edu/tticseminar.php.
>
> For additional questions, please contact Nathan Srebro at nati at ttic.edu
> <mcallester at ttic.edu>
>
>
>
>
> Mary C. Marre
> Administrative Assistant
> *Toyota Technological Institute*
> *6045 S. Kenwood Avenue*
> *Room 504*
> *Chicago, IL  60637*
> *p:(773) 834-1757 <(773)%20834-1757>*
> *f: (773) 357-6970 <(773)%20357-6970>*
> *mmarre at ttic.edu <mmarre at ttic.edu>*
>
> On Mon, May 29, 2017 at 5:59 PM, Mary Marre <mmarre at ttic.edu> wrote:
>
>> When:     Friday, June 2nd at noon
>>
>>
>>
>> Where:    TTIC, 6045 S Kenwood Avenue, 5th Floor, Room 526
>>
>>
>>
>> Who:       Suriya Gunasekar, TTIC
>>
>>
>> *Title:*       Implicit Regularization in Matrix Factorization
>>
>> *Abstract:* This talk will explore ideas on "implicit regularization"
>> in  underdetermined problems where the optimization objective has multiple
>> global minima. We specifically study optimization of a quadratic loss over
>> a matrix with gradient descent on the factorized space. We conjecture and
>> provide empirical and theoretical evidence that with small enough step
>> sizes and initialization close enough to the origin, gradient descent on a
>> full dimensional factorization converges to the minimum nuclear norm
>> solution.
>>
>>
>>
>> ********************************************************************************************************
>>
>> *Research at TTIC Seminar Series*
>>
>> TTIC is hosting a weekly seminar series presenting the research currently
>> underway at the Institute. Every week a different TTIC faculty member
>> will present their research.  The lectures are intended both for
>> students seeking research topics and adviser, and for the general TTIC and
>> University of Chicago communities interested in hearing what their
>> colleagues are up to.
>>
>> To receive announcements about the seminar series, please subscribe to
>> the mailing list: https://groups.google.com/a/ttic.edu/group/talks/subsc
>> ribe
>>
>> Speaker details can be found at: http://www.ttic.edu/tticseminar.php.
>>
>> For additional questions, please contact Nathan Srebro at nati at ttic.edu
>> <mcallester at ttic.edu>
>>
>>
>>
>>
>> Mary C. Marre
>> Administrative Assistant
>> *Toyota Technological Institute*
>> *6045 S. Kenwood Avenue*
>> *Room 504*
>> *Chicago, IL  60637*
>> *p:(773) 834-1757 <(773)%20834-1757>*
>> *f: (773) 357-6970 <(773)%20357-6970>*
>> *mmarre at ttic.edu <mmarre at ttic.edu>*
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20170602/49b14e89/attachment-0001.html>


More information about the Colloquium mailing list