[Theory] TODAY: [TTIC Talks] 2/3 Talks at TTIC: ​Y​ossi Gandelsman, UC Berkeley

[Brandie Jones via Theory]

*When:*        Monday, February 3rd at *11:25am CT*


*Where:       *Talk will be given *live, in-person* at

                       TTIC, 6045 S. Kenwood Avenue

                       5th Floor, Room 530


*Virtually:*  via Panopto (livestream
<https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=9423ae2a-fce6-4d2d-a079-b248011cc3a5>
)


*Who: *         Yossi Gandelsman, UC Berkeley

*Title:*         Interpreting the Inner Workings of Vision Models
*Abstract:  *In this talk, I present an approach for interpreting the
internal computation in deep vision models. I show that these
interpretations can be used to detect model bugs and to improve the
performance of pre-trained deep neural networks (e.g., reducing
hallucinations from image captioners and detecting and removing spurious
correlations in CLIP) without any additional training. Moreover, the
obtained understanding of deep representations can unlock new model
capabilities (e.g., novel identity editing techniques in diffusion models
and faithful image inversion in GANs). I demonstrate how to find common
representations across different models (discriminative and generative) and
how deep representations can be adapted at test-time to improve model
generalization without any additional supervision. Finally, I discuss
future work on improving the presented interpretation techniques and their
application to continual model correction and scientific discovery.

*Short Bio*: Yossi is a EECS PhD at UC Berkeley, advised by Alexei Efros,
and a visiting researcher at Meta. Before that, he was a member of the
perception team at Google Research (now Google-DeepMind). He completed his
M.Sc. at Weizmann Institute, advised by Prof. Michal Irani. His research
centers around deep learning, computer vision, and mechanistic
interpretability.

*Host:  <zhiyuanli at ttic.edu> <nati at ttic.edu>Greg Shaknarovich
<greg at ttic.edu>*


-- 
*Brandie Jones *
*Executive **Administrative Assistant*
Toyota Technological Institute
6045 S. Kenwood Avenue
Chicago, IL  60637
www.ttic.edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/theory/attachments/20250203/c98e9258/attachment.html>