<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small"><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>When:</b> Thursday, January 21st at<b> 11:10 am CT</b></font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Where:</b> Zoom Virtual Talk (<b><a href="https://uchicagogroup.zoom.us/webinar/register/WN_jKnto66aRn-oINh-FV4Q8w" target="_blank">register in advance here</a></b>)</font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Who: </b> Najoung Kim, John Hopkins University</font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Title: </b>What Aspects of Meaning are Missing from Current Natural Language Understanding Systems?</font></p><br><b>Abstract:</b> Natural Language Understanding (NLU) has progressed greatly in the last several years, with models surpassing human performance on widely used benchmarks such as SuperGLUE. In this talk, I highlight two aspects of meaning that are still missing in our NLU systems despite their impressive success. The first is systematic understanding: through a semantic parsing task, I show that systems are biased towards assigning the meaning that they have already encountered during training, even when the structure of the sentence indicates otherwise. The second is understanding of non-asserted meaning: in the context of question-answering, I demonstrate that current systems are unable to handle questions containing failed presuppositions (backgrounded assumptions that need to be satisfied) such as <i><font face="georgia, serif">Which linguist invented the lightbulb?</font></i> sufficiently. <br><br><b>Bio: </b>Najoung Kim is a PhD student in the Department of Cognitive Science at Johns Hopkins University, advised by Paul Smolensky and Kyle Rawlins. Her research is on diagnosing current natural language understanding systems to propose targeted solutions, leveraging insights from linguistics and cognitive science. In particular, she focuses on the understanding of implicit meaning and systematic generalization. Najoung's dissertation work is supported by the NSF, and she has interned at Google and IBM Research.<br><br> <p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Host: </b><a href="mailto:kgimpel@ttic.edu" target="_blank">Kevin Gimpel</a> </font></p><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;margin:0px"></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><br></font></p></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font face="arial, helvetica, sans-serif">Mary C. Marre</font><div><font face="arial, helvetica, sans-serif">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">6045 S. Kenwood Avenue</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Room 517</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i></div><div><i><font face="arial, helvetica, sans-serif">p:(773) 834-1757</font></i></div><div><i><font face="arial, helvetica, sans-serif">f: (773) 357-6970</font></i></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jan 20, 2021 at 4:27 PM Mary Marre <<a href="mailto:mmarre@ttic.edu">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div><div><div><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>When:</b>
Thursday, January 21st at<b> 11:10 am CT</b></font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Where:</b> Zoom Virtual Talk (<b><a href="https://uchicagogroup.zoom.us/webinar/register/WN_jKnto66aRn-oINh-FV4Q8w" target="_blank">register in advance here</a></b>)</font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Who: </b>
Najoung Kim, John Hopkins University</font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Title:
</b>What Aspects of Meaning are Missing from Current Natural Language
Understanding Systems?</font></p><br><b>Abstract:</b> Natural Language Understanding (NLU) has progressed greatly in the last several years, with models surpassing human performance on widely used benchmarks such as SuperGLUE. In this talk, I highlight two aspects of meaning that are still missing in our NLU systems despite their impressive success. The first is systematic understanding: through a semantic parsing task, I show that systems are biased towards assigning the meaning that they have already encountered during training, even when the structure of the sentence indicates otherwise. The second is understanding of non-asserted meaning: in the context of question-answering, I demonstrate that current systems are unable to handle questions containing failed presuppositions (backgrounded assumptions that need to be satisfied) such as <i><font face="georgia, serif">Which linguist invented the lightbulb?</font></i> sufficiently. <br><br><b>Bio: </b>Najoung Kim is a PhD student in the Department of Cognitive Science at Johns Hopkins University, advised by Paul Smolensky and Kyle Rawlins. Her research is on diagnosing current natural language understanding systems to propose targeted solutions, leveraging insights from linguistics and cognitive science. In particular, she focuses on the understanding of implicit meaning and systematic generalization. Najoung's dissertation work is supported by the NSF, and she has interned at Google and IBM Research.<br><br> <p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"><b>Host: </b><a href="mailto:kgimpel@ttic.edu" target="_blank">Kevin Gimpel</a> </font></p><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;margin:0px">
</p><p class="MsoNormal" style="margin:0in;line-height:normal"><font color="#000000" face="arial, sans-serif"> </font></p></div></div></div><div style="font-size:small"><br></div><div style="font-size:small"> <br></div><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font face="arial, helvetica, sans-serif">Mary C. Marre</font><div><font face="arial, helvetica, sans-serif">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">6045 S. Kenwood Avenue</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Room 517</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i></div><div><i><font face="arial, helvetica, sans-serif">p:(773) 834-1757</font></i></div><div><i><font face="arial, helvetica, sans-serif">f: (773) 357-6970</font></i></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jan 14, 2021 at 10:53 PM Mary Marre <<a href="mailto:mmarre@ttic.edu" target="_blank">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div style="font-size:small"><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;margin:0px"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b> </font></font><font style="vertical-align:inherit"><font style="vertical-align:inherit"> Thursday, January 21st at<b> 11:10 am CT</b></font></font><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>Where:</b> </font></font></font><font color="#000000" style="font-family:arial,sans-serif">Zoom Virtual Talk (</font><b style="font-family:arial,sans-serif"><font color="#0000ff"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_jKnto66aRn-oINh-FV4Q8w" target="_blank">register in advance here</a></font></b><font color="#000000" style="font-family:arial,sans-serif">)</font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b>Who: </b> </font></font></font>Najoung Kim, John Hopkins University</p></div><div style="font-size:small"><font face="arial, sans-serif"><br></font></div><font face="arial, sans-serif"><b>Title: </b>What Aspects of Meaning are Missing from Current Natural Language Understanding Systems?<br><br><b>Abstract:</b> Natural Language Understanding (NLU) has progressed greatly in the last several years, with models surpassing human performance on widely used benchmarks such as SuperGLUE. In this talk, I highlight two aspects of meaning that are still missing in our NLU systems despite their impressive success. The first is systematic understanding: through a semantic parsing task, I show that systems are biased towards assigning the meaning that they have already encountered during training, even when the structure of the sentence indicates otherwise. The second is understanding of non-asserted meaning: in the context of question-answering, I demonstrate that current systems are unable to handle questions containing failed presuppositions (backgrounded assumptions that need to be satisfied) such as <i>Which linguist invented the lightbulb?</i> sufficiently.</font></div><div><font face="arial, sans-serif"> <br></font></div><div><font face="arial, sans-serif"><b>Host: </b><a href="mailto:kgimpel@ttic.edu" target="_blank">Kevin Gimpel</a></font></div><div style="font-size:small"><br></div><div style="font-size:small"><br></div></div><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font face="arial, helvetica, sans-serif">Mary C. Marre</font><div><font face="arial, helvetica, sans-serif">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">6045 S. Kenwood Avenue</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Room 517</font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i></div><div><i><font face="arial, helvetica, sans-serif">p:(773) 834-1757</font></i></div><div><i><font face="arial, helvetica, sans-serif">f: (773) 357-6970</font></i></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</blockquote></div></div>
</blockquote></div></div>