<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small"><div class="gmail_default"><div><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b> </font></font><font style="vertical-align:inherit"><font style="vertical-align:inherit"> Monday, February 14th at<b> <span style="background-color:rgb(255,255,0)">11:30 am CT</span></b></font></font><br></font></p><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div class="gmail_default"><b style="font-family:arial,sans-serif">Where: </b><span style="background-color:rgb(255,255,0)"><font color="#500050" style="font-family:arial,sans-serif">Talk will be given </font><font color="#0000ff" face="verdana, sans-serif" style="font-weight:bold"><u>live, in-person</u></font><font color="#0000ff" style="font-family:arial,sans-serif;font-weight:bold"> </font><font color="#000000" style="font-family:arial,sans-serif">at</font></span></div><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> TTIC, 6045 S. Kenwood Avenue</font></p><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> 5th Floor, Room 530<b><span style="color:black"> </span></b></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>Where:</b> </font></font><font style="color:rgb(80,0,80)">Zoom Virtual Talk (</font><a href="https://uchicagogroup.zoom.us/webinar/register/WN_Ijpmbu9PTpS73C_G-4kMLQ" target="_blank"><b><font color="#0000ff">register in advance here</font></b></a><font style="color:rgb(80,0,80)">)</font></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font color="#000000"><b>Who: </b> </font><font color="#500050"> </font><font color="#000000"> </font></font></font></font>Daphne Ippolito, University of Pennsylvania</p></div><div><br></div><div><br></div></div><div class="gmail_default"><b style="font-family:arial,sans-serif;color:rgb(60,64,67)">Title:</b><span style="font-family:arial,sans-serif;color:rgb(60,64,67)"> The Implications of (Near) Human-Level Language Generation by Computers</span><br></div><div class="gmail_default"><p style="color:rgb(60,64,67)"><font face="arial, sans-serif"><b>Abstract: </b>One of the oldest goals of artificial intelligence is to have computers that can use language with human-like ability. State-of-the-art massive neural networks produce remarkably high-quality text. Does this mean we have achieved AI’s longstanding goal? In this talk, I address two concerns about neural text generation systems. First, I present a large-scale, systematic study of how humans and automatic classifiers fare at detecting generated text. I show that the strategies used to produce text that is harder for humans to detect result in generated text that is more detectable by automatic systems. Second, I describe how neural language models are capable of memorizing significant amounts of their training data (potentially raising privacy and copyright concerns). I show that deduplication of training data is an effective mitigation strategy. Despite their limitations, human-level text generation systems provide very exciting opportunities, especially in the area of human-AI collaboration–where language generation tools are used to assist rather than replace human writers. I present Wordcraft, an AI-assisted writing tool developed in collaboration with colleagues at Google, that gives a glimpse into the future of next-generation word processors.</font></p><p style="color:rgb(60,64,67)"><font face="arial, sans-serif"><b>Bio: </b>Daphne Ippolito is a final-year PhD student at University of Pennsylvania and a research scientist at Google Brain. She is co-advised by Professor Chris Callison-Burch at UPenn and Principal Scientist Douglas Eck at Google. Her research focuses on large-scale neural language models for text generation, spanning multiple dimensions, including decoding strategies, evaluation methods, and use in creative-writing applications. During her PhD, she has published over eight papers at top venues, including ACL, EMNLP, and NeurIPS. Prior to UPenn, she completed her bachelors at University of Toronto.</font></p><p style="color:rgb(60,64,67)"><b style="font-family:arial,sans-serif;color:rgb(34,34,34)">H</b><span class="gmail_default" style="font-family:arial,sans-serif;color:rgb(34,34,34)"><b>ost:<font color="#0000ff"> <a href="mailto:klivescu@ttic.edu" target="_blank">Karen Livescu</a></font></b></span></p></div><div><div dir="ltr"><div dir="ltr"><br></div><div dir="ltr"><br></div></div></div></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Feb 13, 2022 at 4:08 PM Mary Marre <<a href="mailto:mmarre@ttic.edu">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div style="font-size:small"><div><div><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b> </font></font><font style="vertical-align:inherit"><font style="vertical-align:inherit"> Monday, February 14th at<b> <span style="background-color:rgb(255,255,0)">11:30 am CT</span></b></font></font><br></font></p><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div><b style="font-family:arial,sans-serif">Where: </b><span style="background-color:rgb(255,255,0)"><font color="#500050" style="font-family:arial,sans-serif">Talk will be given </font><font color="#0000ff" face="verdana, sans-serif" style="font-weight:bold"><u>live, in-person</u></font><font color="#0000ff" style="font-family:arial,sans-serif;font-weight:bold"> </font><font color="#000000" style="font-family:arial,sans-serif">at</font></span></div><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> TTIC, 6045 S. Kenwood Avenue</font></p><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> 5th Floor, Room 530<b><span style="color:black"> </span></b></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>Where:</b> </font></font><font style="color:rgb(80,0,80)">Zoom Virtual Talk (</font><a href="https://uchicagogroup.zoom.us/webinar/register/WN_Ijpmbu9PTpS73C_G-4kMLQ" target="_blank"><b><font color="#0000ff">register in advance here</font></b></a><font style="color:rgb(80,0,80)">)</font></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font color="#000000"><b>Who: </b> </font><font color="#500050"> </font><font color="#000000"> </font></font></font></font>Daphne Ippolito, University of Pennsylvania</p></div><div><br></div><div><br></div></div><div><b style="font-family:arial,sans-serif;color:rgb(60,64,67)">Title:</b><span style="font-family:arial,sans-serif;color:rgb(60,64,67)"> The Implications of (Near) Human-Level Language Generation by Computers</span><br></div><div><p style="color:rgb(60,64,67)"><font face="arial, sans-serif"><b>Abstract: </b>One of the oldest goals of artificial intelligence is to have computers that can use language with human-like ability. State-of-the-art massive neural networks produce remarkably high-quality text. Does this mean we have achieved AI’s longstanding goal? In this talk, I address two concerns about neural text generation systems. First, I present a large-scale, systematic study of how humans and automatic classifiers fare at detecting generated text. I show that the strategies used to produce text that is harder for humans to detect result in generated text that is more detectable by automatic systems. Second, I describe how neural language models are capable of memorizing significant amounts of their training data (potentially raising privacy and copyright concerns). I show that deduplication of training data is an effective mitigation strategy. Despite their limitations, human-level text generation systems provide very exciting opportunities, especially in the area of human-AI collaboration–where language generation tools are used to assist rather than replace human writers. I present Wordcraft, an AI-assisted writing tool developed in collaboration with colleagues at Google, that gives a glimpse into the future of next-generation word processors.</font></p><p style="color:rgb(60,64,67)"><font face="arial, sans-serif"><b>Bio: </b>Daphne Ippolito is a final-year PhD student at University of Pennsylvania and a research scientist at Google Brain. She is co-advised by Professor Chris Callison-Burch at UPenn and Principal Scientist Douglas Eck at Google. Her research focuses on large-scale neural language models for text generation, spanning multiple dimensions, including decoding strategies, evaluation methods, and use in creative-writing applications. During her PhD, she has published over eight papers at top venues, including ACL, EMNLP, and NeurIPS. Prior to UPenn, she completed her bachelors at University of Toronto.</font></p><p style="color:rgb(60,64,67)"><b style="font-family:arial,sans-serif;color:rgb(34,34,34)">H</b><span class="gmail_default" style="font-family:arial,sans-serif;color:rgb(34,34,34)"><b>ost:<font color="#0000ff"> <a href="mailto:klivescu@ttic.edu" target="_blank">Karen Livescu</a></font></b></span></p></div><div><div dir="ltr"><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr"><br></div></div></div></div><div><div dir="ltr"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 7, 2022 at 9:07 PM Mary Marre <<a href="mailto:mmarre@ttic.edu" target="_blank">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="font-size:small"><div><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b> </font></font><font style="vertical-align:inherit"><font style="vertical-align:inherit"> Monday, February 14th at<b> <span style="background-color:rgb(255,255,0)">11:30 am CT</span></b></font></font><br></font></p><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div><b style="font-family:arial,sans-serif">Where: </b><span style="background-color:rgb(255,255,0)"><font color="#500050" style="font-family:arial,sans-serif">Talk will be given </font><font color="#0000ff" face="verdana, sans-serif" style="font-weight:bold"><u>live, in-person</u></font><font color="#0000ff" style="font-family:arial,sans-serif;font-weight:bold"> </font><font color="#000000" style="font-family:arial,sans-serif">at</font></span></div><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> TTIC, 6045 S. Kenwood Avenue</font></p><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> 5th Floor, Room 530<b><span style="color:black"> </span></b></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>Where:</b> </font></font><font style="color:rgb(80,0,80)">Zoom Virtual Talk (</font><a href="https://uchicagogroup.zoom.us/webinar/register/WN_Ijpmbu9PTpS73C_G-4kMLQ" target="_blank"><b><font color="#0000ff">register in advance here</font></b></a><font style="color:rgb(80,0,80)">)</font></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font color="#000000"><b>Who: </b> </font><font color="#500050"> </font><font color="#000000"> </font></font></font></font>Daphne Ippolito, University of Pennsylvania</p></div><div><br></div><div><br></div></div><div style="font-size:small"><b style="font-family:arial,sans-serif;color:rgb(60,64,67)">Title:</b><span style="font-family:arial,sans-serif;color:rgb(60,64,67)"> The Implications of (Near) Human-Level Language Generation by Computers</span><br></div><div><p style="color:rgb(60,64,67)"><font face="arial, sans-serif" style="background-color:rgb(255,255,255)"><b>Abstract: </b>One of the oldest goals of artificial intelligence is to have computers that can use language with human-like ability. State-of-the-art massive neural networks produce remarkably high-quality text. Does this mean we have achieved AI’s longstanding goal? In this talk, I address two concerns about neural text generation systems. First, I present a large-scale, systematic study of how humans and automatic classifiers fare at detecting generated text. I show that the strategies used to produce text that is harder for humans to detect result in generated text that is more detectable by automatic systems. Second, I describe how neural language models are capable of memorizing significant amounts of their training data (potentially raising privacy and copyright concerns). I show that deduplication of training data is an effective mitigation strategy. Despite their limitations, human-level text generation systems provide very exciting opportunities, especially in the area of human-AI collaboration–where language generation tools are used to assist rather than replace human writers. I present Wordcraft, an AI-assisted writing tool developed in collaboration with colleagues at Google, that gives a glimpse into the future of next-generation word processors.</font></p><p style="color:rgb(60,64,67)"><font face="arial, sans-serif" style="background-color:rgb(255,255,255)"><b>Bio: </b>Daphne Ippolito is a final-year PhD student at University of Pennsylvania and a research scientist at Google Brain. She is co-advised by Professor Chris Callison-Burch at UPenn and Principal Scientist Douglas Eck at Google. Her research focuses on large-scale neural language models for text generation, spanning multiple dimensions, including decoding strategies, evaluation methods, and use in creative-writing applications. During her PhD, she has published over eight papers at top venues, including ACL, EMNLP, and NeurIPS. Prior to UPenn, she completed her bachelors at University of Toronto.</font></p><p style="color:rgb(60,64,67)"><b style="font-family:arial,sans-serif;color:rgb(34,34,34)">H</b><span class="gmail_default" style="font-family:arial,sans-serif;color:rgb(34,34,34)"><b>ost:<font color="#0000ff"> <a href="mailto:klivescu@ttic.edu" target="_blank">Karen Livescu</a></font></b></span></p></div><div><div dir="ltr"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small"><span class="gmail_default" style="font-size:small"><br></span></span></div><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small"><span class="gmail_default" style="font-size:small"><br></span></span></div><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small"><span class="gmail_default" style="font-size:small"><br></span></span></div><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small"><span class="gmail_default" style="font-size:small"></span></span></div><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div>
</blockquote></div></div>
</blockquote></div></div>