[Theory] REMINDER: [TTIC Talks] 5/23 Research at TTIC: Sam Buchanan, TTIC

[Brandie Jones via Theory]

*When:         *May 23rd *at 12:30pm CT  *


*Where:*        Talk will be given *live, in-person* at

                       TTIC, 6045 S. Kenwood Avenue

                        5th Floor, Room 530


*Virtually:*    via Panopto (Livestream
<https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=1f1d2eb6-4976-4aac-9ed6-b1f701151572>
)



*Who:*            Sam Buchanan, TTIC



*Title*:             On the Edge of Memorization in Diffusion Models


*Abstract:*   When do diffusion models reproduce their training data, and
when are they able to generate samples beyond it? A practically relevant
theoretical understanding of this interplay between memorization and
generalization may significantly impact real-world deployments of diffusion
models with respect to issues such as copyright infringement and data
privacy.


In this paper, we propose a scientific and mathematical “laboratory” for
investigating memorization and generalization in diffusion models trained
on fully synthetic or natural image-like structured data. Within this
setting, we theoretically characterize a crossover point wherein the
weighted training loss of a fully generalizing model becomes greater than
that of an underparameterized memorizing model at a critical value of model
(under)parameterization.


We then demonstrate via carefully-designed experiments that the location of
this crossover predicts a phase transition in models trained via gradient
descent, as our theory enables us to analytically predict the model size at
which memorization becomes predominant. Our work provides an analytically
tractable and practically meaningful setting for future theoretical and
empirical investigations.
***********************************************************************************************

*Masks are optional in all common areas. **Full visitor guidance is
available at ttic.edu/visitors <http://ttic.edu/visitors>.*

***********************************************************************************************

*Research at TTIC Seminar Series*



TTIC is hosting a weekly seminar series presenting the research currently
underway at the Institute. Every week a different TTIC faculty member will
present their research.  The lecture



-- 
*Brandie Jones *
*Executive **Administrative Assistant*
Toyota Technological Institute
6045 S. Kenwood Avenue
Chicago, IL  60637
www.ttic.edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/theory/attachments/20250522/477b6a6f/attachment.html>