<div dir="ltr"><div class="gmail_default" style="font-size:small"><font style="color:rgb(0,0,0);font-family:arial,sans-serif;vertical-align:inherit"><font style="vertical-align:inherit"><b>When:</b>    </font></font><font style="color:rgb(0,0,0);font-family:arial,sans-serif;vertical-align:inherit"><font style="vertical-align:inherit">    Tuesday, February 15th at<b> <span style="background-color:rgb(255,255,0)">11:00 am CT</span></b></font></font></div><div><p style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;line-height:normal;color:rgb(80,0,80);margin:0px"><font face="arial, sans-serif" color="#000000"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><b><span style="background-color:rgb(255,255,0)"><br></span></b></font></font></font></p><div class="gmail_default"><b style="font-family:arial,sans-serif">Where:       </b><span style="background-color:rgb(255,255,0)"><font color="#500050" style="font-family:arial,sans-serif">Talk will be given </font><font color="#0000ff" face="verdana, sans-serif" style="font-weight:bold"><u>live, in-person</u></font><font color="#0000ff" style="font-family:arial,sans-serif;font-weight:bold"> </font><font color="#000000" style="font-family:arial,sans-serif">at</font></span></div><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif">                   TTIC, 6045 S. Kenwood Avenue</font></p><p class="MsoNormal" style="margin:0in;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif">                   5th Floor, Room 530<b><span style="color:black"> </span></b></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" color="#000000"> </font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="color:rgb(0,0,0);vertical-align:inherit"><font style="vertical-align:inherit"><b>Where:</b>       </font></font><font style="color:rgb(80,0,80)">Zoom Virtual Talk (</font><a href="https://uchicagogroup.zoom.us/webinar/register/WN_ApMvOwCsR1uRaTZ_wcls0A" target="_blank"><b><font color="#0000ff">register in advance here</font></b></a><font style="color:rgb(80,0,80)">)</font></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;color:rgb(80,0,80);line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><br></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><font style="vertical-align:inherit"><font style="vertical-align:inherit"><font color="#000000"><b>Who: </b> </font><font color="#500050">    </font><font color="#000000">    </font></font></font></font><span class="gmail_default" style="font-size:small"></span>Nakul Gopalan, Georgia Tech</p></div><div><br></div><div class="gmail_default" style=""><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><b style=""><br class="gmail-Apple-interchange-newline"><font face="arial, sans-serif" style="">Title</font></b><font face="arial, sans-serif" style="">:          Robots, Language, and Representations</font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif"><br></font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif"><b><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-weight:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:inherit">Abstract</span></b>: Robots are increasingly present in our lives, from cleaning our houses to automating logistics. However, these robots are still present in our lives as solitary agents, performing structured tasks, without the power to collaborate and learn with humans. </font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif"><br></font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif">A key challenge here is that robots perceive the world and operate in it using sensors and actuators that are continuous, low-level and noisy. However, people on the other hand, reason, plan, specify and teach tasks using high-level concepts without worrying about the low-level continuous nature of the world. To address this challenge, I develop computational methods that firstly, allow robots to learn representations, and skills to solve novel tasks. Moreover, these methods, and representations also enable robots to be taught and programmed using natural language communication, allowing robots to understand a human partner's intent.</font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif"><br aria-hidden="true"></font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif">In this talk I first demonstrate how representations for planning and language understanding can be learned together to follow commands in novel environments. In the second part of the talk, I demonstrate a more practical approach in which language can be grounded to pre-trained deep policy representations to solve novel task specifications.</font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif">Together, these approaches empower robots to learn unstructured tasks via language and demonstrations. I will then discuss the implications of such approaches in collaborative task solving with robots in homes, offices and industries.</font></div><div style="margin:0px;padding:0px;border:0px;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;color:rgb(0,0,0)"><font face="arial, sans-serif"><br></font></div><div style=""><font face="arial, sans-serif"><b style="color:rgb(0,0,0)">Bio</b><span style="color:rgb(0,0,0)">: Nakul Gopalan is a postdoctoral researcher in the CORE Robotics Lab with Prof. Matthew Gombolay at Georgia Tech. He completed his PhD at Brown University's Computer Science department in 2019. Previously he was a graduate student in Prof. Stefanie Tellex's H2R lab at Brown. His research interests lie at the intersection of language grounding and robot learning. Nakul has developed algorithms and methods that allow robots to be trained by leveraging demonstrations and natural language descriptions. Such learning would improve the usability of robots within homes and offices. His other research interests are in hierarchical reinforcement learning and planning. His work has received a best paper award at the RoboNLP workshop at ACL 2017.</span></font></div><div style=""><font face="arial, sans-serif"><br></font></div><div style=""><font color="#000000" face="arial, sans-serif"><b>Host:</b> <a href="mailto:mwalter@ttic.edu"><b>Matthew Walter</b></a></font></div><div style=""><font color="#000000" face="arial, sans-serif"><br></font></div><div style=""><font color="#000000" face="Calibri, sans-serif"><br></font></div></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div>