<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif;font-size:12.8px"><font style="font-family:arial,sans-serif;font-size:small;color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b>    </font></font><font style="font-family:Arial,Helvetica,sans-serif;font-size:small;vertical-align:inherit"><font style="vertical-align:inherit"><font style="color:rgb(0,0,0)">    Wednesday</font><span class="gmail_default" style="font-family:arial,sans-serif;color:rgb(0,0,0)">, November 16th</span><font style="color:rgb(0,0,0)"> at</font><b style="color:rgb(0,0,0)"> <span style="background-color:rgb(255,255,0)"><u>10:30</u></span></b><b><u><font face="verdana, sans-serif" color="#000000" style="background-color:rgb(255,255,0)"> a</font></u></b><font face="verdana, sans-serif"><b><u><font color="#000000" style="background-color:rgb(255,255,0)">m CT</font></u><font color="#000000"><span style="background-color:rgb(255,255,0)">   </span></font></b></font></font></font><br></div></div><div><p style="color:rgb(80,0,80);font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div class="gmail_default"><font face="arial, sans-serif"><b><font color="#500050">Where:      </font><font color="#000000"> </font></b><font color="#000000">Talk will be given </font><font color="#0000ff" style="font-weight:bold"><u>live, in-person</u></font><font style="color:rgb(80,0,80);font-weight:bold"> </font><font style="color:rgb(80,0,80)">at</font></font></div><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font color="#500050">               </font><font color="#000000">    TTIC, 6045 S. Kenwood Avenue</font></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000">                   5th Floor, Room 530<b> </b></font></p><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black"><br></span></b></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><b style="color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">Virtually:</b><span style="font-size:14px;color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">    <i>via</i> Panopto </span>(<b><a href="https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=72cf36c1-6849-4d1f-acca-af480189a155" target="_blank">livestream</a></b><span style="font-size:14px;color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">)</span><br></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font style="color:rgb(80,0,80)"><b>Who: </b> </font><font color="#500050" style="color:rgb(80,0,80)">    </font><font color="#000000"><font color="#500050">    </font></font></font></font></font>Lisa Li, Stanford University</p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><br></p><div class="MsoNormal" align="center" style="margin:0in 0in 8pt;font-size:11pt;text-align:center;line-height:15.6933px;font-family:Calibri,sans-serif"><hr size="2" width="100%" align="center"></div><div><p style="color:rgb(60,64,67);letter-spacing:0.2px;white-space:pre-wrap"><font face="arial, sans-serif"><span style="letter-spacing:normal;color:rgb(34,34,34)"><b>Title:</b>          Diffusion-LM Improves Controllable Text Generation.</span><br></font></p><div><font face="arial, sans-serif"><b>Abstract: </b><span style="color:rgb(80,0,80)">Controlling the behavior of language models (LMs) without </span>re-training<span style="color:rgb(80,0,80)"> is a major open problem in natural language generation. While recent works have demonstrated successes on controlling simple sentence attributes (e.g., sentiment), there has been little progress on complex, fine-grained controls (e.g., syntactic structure). To address this challenge, we develop a new non-autoregressive language model based on continuous diffusions that we call Diffusion-LM. Building upon the recent successes of diffusion models in continuous domains, Diffusion-LM iteratively denoises a sequence of Gaussian vectors into word vectors, yielding a sequence of intermediate latent variables. The continuous, hierarchical nature of these intermediate variables enables a simple gradient-based algorithm to perform complex, controllable generation tasks. We demonstrate successful control of Diffusion-LM for six challenging fine-grained control tasks, significantly outperforming prior work.</span></font></div><div><span style="color:rgb(80,0,80)"><font face="arial, sans-serif"><br></font></span></div><font face="arial, sans-serif"><b>Bio:</b> <i>Xiang Lisa Li</i> is a third-year PhD student in computer science at Stanford University, advised by Percy Liang and Tatsunori Hashimoto. She works on controllable text generation and efficient adaptation of pre-trained language models. Lisa is supported by a Stanford Graduate Fellowship and is the recipient of an EMNLP Best Paper award.</font><div dir="ltr"><span style="color:rgb(80,0,80)"><font face="arial, sans-serif"><div><br></div></font></span></div><b>Host: <a href="mailto:mcallester@ttic.edu" target="_blank">David McAllester</a></b></div><div><br></div></div><div><div style="font-size:12.8px"><font face="arial, helvetica, sans-serif">**************************************************************************************************<br></font></div><div style="font-size:12.8px"><div><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif"> </font></p><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif">The <font color="#3d85c6"><i><b>TTIC <span class="gmail-il">Young</span> <span class="gmail-il">Researcher</span> Seminar Series</b></i></font> (<a href="http://www.ttic.edu/young-researcher.php" target="_blank">http://www.ttic.edu/<span class="gmail-il">young</span>-<span class="gmail-il">researcher</span>.php</a>) features talks by Ph.D. students and postdocs whose <span class="gmail-il">research</span> is of broad interest to the computer science community. The series provides an opportunity for <span class="gmail-il">early</span>-<span class="gmail-il">career</span> <span class="gmail-il">researchers</span> to present recent work to and meet with students and faculty at TTIC and nearby universities.</font></p><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif"><br>The seminars are typically held on Wednesdays at 10:30am in TTIC Room 530.<br><br>For additional information, please contact <i>David McAllester </i>(<a href="mailto:mcallester@ttic.edu" target="_blank">mcallester@ttic.edu</a>).</font></p><br class="gmail-Apple-interchange-newline"></div><div><br></div><div><br></div><div><br></div></div></div></div><div><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue, Rm 517</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">773-834-1757</font></i></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 9, 2022 at 6:17 PM Mary Marre <<a href="mailto:mmarre@ttic.edu">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div dir="ltr" style="font-size:small"><div style="font-family:arial,helvetica,sans-serif;font-size:12.8px"><font style="font-family:arial,sans-serif;font-size:small;color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b>    </font></font><font style="font-family:Arial,Helvetica,sans-serif;font-size:small;vertical-align:inherit"><font style="vertical-align:inherit"><font style="color:rgb(0,0,0)">    Wednesday</font><span class="gmail_default" style="font-family:arial,sans-serif;color:rgb(0,0,0)">, November 16th</span><font style="color:rgb(0,0,0)"> at</font><b style="color:rgb(0,0,0)"> <span style="background-color:rgb(255,255,0)"><u>10:30</u></span></b><b><u><font face="verdana, sans-serif" style="background-color:rgb(255,255,0)" color="#000000"> a</font></u></b><font face="verdana, sans-serif"><b><u><font style="background-color:rgb(255,255,0)" color="#000000">m CT</font></u><font color="#000000"><span style="background-color:rgb(255,255,0)">   </span></font></b></font></font></font><br></div></div><div><p style="font-size:small;color:rgb(80,0,80);font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div style="font-size:small"><font face="arial, sans-serif"><b><font color="#500050">Where:      </font><font color="#000000"> </font></b><font color="#000000">Talk will be given </font><font color="#0000ff" style="font-weight:bold"><u>live, in-person</u></font><font style="color:rgb(80,0,80);font-weight:bold"> </font><font style="color:rgb(80,0,80)">at</font></font></div><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font color="#500050">               </font><font color="#000000">    TTIC, 6045 S. Kenwood Avenue</font></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000">                   5th Floor, Room 530<b> </b></font></p><p class="MsoNormal" style="font-size:small;margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black"><br></span></b></font></p><p class="MsoNormal" style="font-size:small;margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><b style="color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">Virtually:</b><span style="font-size:14px;color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">    <i>via</i> Panopto </span>(<b><a href="https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=72cf36c1-6849-4d1f-acca-af480189a155" target="_blank">livestream</a></b><span style="font-size:14px;color:rgb(60,64,67);font-family:Roboto,Arial,sans-serif;letter-spacing:0.2px;white-space:pre-wrap">)</span><br></p><p class="MsoNormal" style="font-size:small;margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="font-size:small;margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font style="color:rgb(80,0,80)"><b>Who: </b> </font><font color="#500050" style="color:rgb(80,0,80)">    </font><font color="#000000"><font color="#500050">    </font></font></font></font></font>Lisa Li, Stanford University</p><p class="MsoNormal" style="font-size:small;margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><br></p><div class="MsoNormal" align="center" style="font-size:11pt;margin:0in 0in 8pt;text-align:center;line-height:15.6933px;font-family:Calibri,sans-serif"><hr size="2" width="100%" align="center"></div><div><p style="color:rgb(60,64,67);letter-spacing:0.2px;white-space:pre-wrap"><font face="arial, sans-serif"><span style="letter-spacing:normal;color:rgb(34,34,34)"><b>Title:</b>          Diffusion-LM Improves Controllable Text Generation.</span><br></font></p><div><font face="arial, sans-serif"><b>Abstract: </b><span style="color:rgb(80,0,80)">Controlling the behavior of language models (LMs) without </span>re-training<span style="color:rgb(80,0,80)"> is a major open problem in natural language generation. While recent works have demonstrated successes on controlling simple sentence attributes (e.g., sentiment), there has been little progress on complex, fine-grained controls (e.g., syntactic structure). To address this challenge, we develop a new non-autoregressive language model based on continuous diffusions that we call Diffusion-LM. Building upon the recent successes of diffusion models in continuous domains, Diffusion-LM iteratively denoises a sequence of Gaussian vectors into word vectors, yielding a sequence of intermediate latent variables. The continuous, hierarchical nature of these intermediate variables enables a simple gradient-based algorithm to perform complex, controllable generation tasks. We demonstrate successful control of Diffusion-LM for six challenging fine-grained control tasks, significantly outperforming prior work.</span></font></div><div><span style="color:rgb(80,0,80)"><font face="arial, sans-serif"><br></font></span></div><font face="arial, sans-serif"><b>Bio:</b> <i>Xiang Lisa Li</i> is a third-year PhD student in computer science at Stanford University, advised by Percy Liang and Tatsunori Hashimoto. She works on controllable text generation and efficient adaptation of pre-trained language models. Lisa is supported by a Stanford Graduate Fellowship and is the recipient of an EMNLP Best Paper award. </font><div dir="ltr"><span style="color:rgb(80,0,80)"><font face="arial, sans-serif"><div><br></div></font></span></div><b style="font-size:small">Host: <a href="mailto:mcallester@ttic.edu" target="_blank">David McAllester</a></b></div><div style="font-size:small"><br></div></div><div style="font-size:small"><div style="font-size:12.8px"><font face="arial, helvetica, sans-serif">**************************************************************************************************<br></font></div><div style="font-size:12.8px"><div><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif"> </font></p><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif">The <font color="#3d85c6"><i><b>TTIC <span>Young</span> <span>Researcher</span> Seminar Series</b></i></font> (<a href="http://www.ttic.edu/young-researcher.php" target="_blank">http://www.ttic.edu/<span>young</span>-<span>researcher</span>.php</a>) features talks by Ph.D. students and postdocs whose <span>research</span> is of broad interest to the computer science community. The series provides an opportunity for <span>early</span>-<span>career</span> <span>researchers</span> to present recent work to and meet with students and faculty at TTIC and nearby universities.</font></p><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif"><br>The seminars are typically held on Wednesdays at 10:30am in TTIC Room 530.<br><br>For additional information, please contact <i>David McAllester </i>(<a href="mailto:mcallester@ttic.edu" target="_blank">mcallester@ttic.edu</a>).</font></p><p class="MsoNormal" style="margin-bottom:0.0001pt;font-family:arial,sans-serif"><font face="arial, helvetica, sans-serif"><br></font></p><br></div></div></div></div><div><div dir="ltr"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue, Rm 517</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">773-834-1757</font></i></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div>
</blockquote></div></div>