<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small"><div class="gmail_default"><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b>When: </b>Monday, February 7th at <b>11:30am CT</b></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black"> Zoom Virtual Talk (</span><b><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_2OEpDElMRPmwXx6tyxneKA" target="_blank" style="color:rgb(5,99,193)"><span style="color:rgb(17,85,204)">register in advance here</span></a></span></b><span style="color:black">)</span></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black"> </span><span style="color:rgb(80,0,80)"> </span>Xiang Lorraine Li, UMass Amherst </font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><br></font></p></div><div class="gmail_default"><b>Title: </b> Probabilistic Commonsense Knowledge in NLP<br><br><b><font face="arial, sans-serif">Abstract: </font></b>Commonsense knowledge is critical to achieving artificial general intelligence. This shared common background knowledge is implicit in all human communication, facilitating efficient information exchange and understanding. But commonsense research is hampered by its immense quantity of knowledge because an explicit categorization is impossible. Furthermore, a plumber could repair a sink in a kitchen or a bathroom, indicating that common sense reveals a probable assumption rather than a definitive answer. To align with these properties of commonsense fundamentally, we want to not only model but also evaluate such knowledge human-like using abstractions and probabilistic principles.<br><br>Traditional combinatorial probabilistic models, e.g., PGM approaches, have limitations to modeling large-scale probability distributions containing thousands or even millions of commonsensical events. On the other hand, although embedding-based representation learning has the advantage of generalizing to large combinations of events, they suffer from producing consistent probabilities under different styles of queries. Combining benefits from both sides, we introduce probabilistic box embeddings, which represent joint probability distributions on a learned latent space of geometric embeddings. By using box embeddings, it is now possible to handle queries with intersections, unions, and negations in a way similar to Venn diagram reasoning, which has faced difficulty even when using large language models.<br><br>Meanwhile, existing evaluations do not reflect the probabilistic nature of commonsense knowledge. The popular multiple-choice evaluation style often misleads us into the paradigm that commonsense solved. To fill in the gap, we propose a method of retrieving commonsense related question answer distributions from human annotators as well as a novel method of generative evaluation. We utilize these approaches in two new commonsense datasets (ProtoQA, Commonsense frame completion).<div class="gmail_default"><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b><br></b></span></font></div><div class="gmail_default"><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b>Host</b>: </span><a href="mailto:klivescu@ttic.edu" target="_blank"><b>Karen Livescu</b></a></font></div><div class="gmail_default"><br></div><div class="gmail_default"><br></div></div></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Feb 6, 2022 at 3:46 PM Mary Marre <<a href="mailto:mmarre@ttic.edu">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div style="font-size:small"><div><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b>When: </b>Monday, February 7th at <b>11:30am CT</b></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black"> Zoom Virtual <span>Talk</span> (</span><b><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_2OEpDElMRPmwXx6tyxneKA" style="color:rgb(5,99,193)" target="_blank"><span style="color:rgb(17,85,204)">register in advance here</span></a></span></b><span style="color:black">)</span></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black"> </span><span style="color:rgb(80,0,80)"> </span>Xiang Lorraine Li, UMass Amherst </font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><br></font></p></div><div><b>Title: </b> Probabilistic Commonsense Knowledge in NLP<br><br><b><font face="arial, sans-serif">Abstract: </font></b>Commonsense knowledge is critical to achieving artificial general intelligence. This shared common background knowledge is implicit in all human communication, facilitating efficient information exchange and understanding. But commonsense research is hampered by its immense quantity of knowledge because an explicit categorization is impossible. Furthermore, a plumber could repair a sink in a kitchen or a bathroom, indicating that common sense reveals a probable assumption rather than a definitive answer. To align with these properties of commonsense fundamentally, we want to not only model but also evaluate such knowledge human-like using abstractions and probabilistic principles.<br><br>Traditional combinatorial probabilistic models, e.g., PGM approaches, have limitations to modeling large-scale probability distributions containing thousands or even millions of commonsensical events. On the other hand, although embedding-based representation learning has the advantage of generalizing to large combinations of events, they suffer from producing consistent probabilities under different styles of queries. Combining benefits from both sides, we introduce probabilistic box embeddings, which represent joint probability distributions on a learned latent space of geometric embeddings. By using box embeddings, it is now possible to handle queries with intersections, unions, and negations in a way similar to Venn diagram reasoning, which has faced difficulty even when using large language models.<br><br>Meanwhile, existing evaluations do not reflect the probabilistic nature of commonsense knowledge. The popular multiple-choice evaluation style often misleads us into the paradigm that commonsense solved. To fill in the gap, we propose a method of retrieving commonsense related question answer distributions from human annotators as well as a novel method of generative evaluation. We utilize these approaches in two new commonsense datasets (ProtoQA, Commonsense frame completion).<div><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b><br></b></span></font></div><div><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b>Host</b>: </span><a href="mailto:klivescu@ttic.edu" target="_blank"><b>Karen Livescu</b></a></font></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div></div></div><div><div dir="ltr"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jan 31, 2022 at 6:23 PM Mary Marre <<a href="mailto:mmarre@ttic.edu" target="_blank">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b>When: </b>Monday, February 7th at <b>11:30am CT</b></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black"> Zoom Virtual Talk (</span><b><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_2OEpDElMRPmwXx6tyxneKA" style="color:rgb(5,99,193)" target="_blank"><span style="color:rgb(17,85,204)">register in advance here</span></a></span></b><span style="color:black">)</span></font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black"> </span><span style="color:rgb(80,0,80)"> </span>Xiang Lorraine Li, UMass Amherst </font></p><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:13.91px"><font face="arial, sans-serif"><br></font></p></div><div><b>Title: </b> Probabilistic Commonsense Knowledge in NLP<br><br><b><font face="arial, sans-serif">Abstract: </font></b>Commonsense knowledge is critical to achieving artificial general intelligence. This shared common background knowledge is implicit in all human communication, facilitating efficient information exchange and understanding. But commonsense research is hampered by its immense quantity of knowledge because an explicit categorization is impossible. Furthermore, a plumber could repair a sink in a kitchen or a bathroom, indicating that common sense reveals a probable assumption rather than a definitive answer. To align with these properties of commonsense fundamentally, we want to not only model but also evaluate such knowledge human-like using abstractions and probabilistic principles.<br><br>Traditional combinatorial probabilistic models, e.g., PGM approaches, have limitations to modeling large-scale probability distributions containing thousands or even millions of commonsensical events. On the other hand, although embedding-based representation learning has the advantage of generalizing to large combinations of events, they suffer from producing consistent probabilities under different styles of queries. Combining benefits from both sides, we introduce probabilistic box embeddings, which represent joint probability distributions on a learned latent space of geometric embeddings. By using box embeddings, it is now possible to handle queries with intersections, unions, and negations in a way similar to Venn diagram reasoning, which has faced difficulty even when using large language models.<br><br>Meanwhile, existing evaluations do not reflect the probabilistic nature of commonsense knowledge. The popular multiple-choice evaluation style often misleads us into the paradigm that commonsense solved. To fill in the gap, we propose a method of retrieving commonsense related question answer distributions from human annotators as well as a novel method of generative evaluation. We utilize these approaches in two new commonsense datasets (ProtoQA, Commonsense frame completion).<div><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b><br></b></span></font></div><div><font face="arial, sans-serif"><span style="color:rgb(17,17,17)"><b>Host</b>: </span><a href="mailto:klivescu@ttic.edu" target="_blank"><b>Karen Livescu</b></a></font></div><div><br></div><div><br></div><div><br></div><div><br></div></div></div><div><div dir="ltr"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL 60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div>
</blockquote></div></div>
</blockquote></div></div>