<div dir="ltr"><div class="gmail_default" style=""><div class="gmail_default" style=""><div class="gmail_default" style=""><div class="gmail_default" style=""><font color="#000000" face="georgia, serif" style=""><b style="">When:</b>         November 1st<b style=""> at <span style="background-color:rgb(255,255,0)">12:30pm CT  </span></b></font><div dir="ltr" style=""><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif"> <br><b>Where:</b><b>  </b>      Talk will be given<span style="background-color:rgb(255,255,0)"> </span><span style="background-color:rgb(255,255,0)"><font style="font-weight:bold"><u>live, in-person</u></font><font style="font-weight:bold"> </font></span>at</font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif">                       TTIC, 6045 S. Kenwood Avenue</font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif">                        5th Floor, Room 530<b>              </b>   </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif"><br></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif" color="#000000"><b><span class="gmail_default"></span>Virtually:</b>    via Panopto (<a href="https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=e4e73f4e-ffcb-4639-b0e2-b1a901057968" target="_blank">Livestream</a>) </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif" color="#000000"><b>Who:</b><b> </b>          Jingyan Wang, TTIC</font></p><table border="0" cellspacing="0" cellpadding="0" width="0" style="width:0in;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;border-collapse:collapse"><tbody><tr><td style="padding:0in"></td></tr></tbody></table><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif"> <span class="gmail_default"></span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif" color="#000000"><b>Title</b>:           Learning from people: Data elicitation and bias mitigation</font></p><font face="georgia, serif" color="#000000"><br></font><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif" color="#000000"><b>Abstract</b>:   <span style="background-color:transparent">Evaluation – to estimate the quality of items or people – arises in many real-world applications such as admissions, grading, hiring, and peer review. In this talk, I will discuss two directions of my research towards understanding and improving evaluation problems. </span></font></p><font face="georgia, serif" color="#000000"><br style=""></font><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;vertical-align:baseline"><font face="georgia, serif" color="#000000">(1) Bias mitigation: We consider bias mitigation in a sequential setting, where an evaluator rates candidates in an online, irrevocable fashion. We propose a natural model for the evaluator's rating process that captures the lack of calibration inherent to this task, supported by the psychology literature, theoretical results, and crowdsourcing experiments. Under this model, we propose a near-linear online algorithm for bias correction and show that it is information-theoretically optimal, outperforming the de facto approach of using the ranking induced by the raw scores. </font></span></p><font face="georgia, serif" color="#000000"><br style=""></font><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;vertical-align:baseline"><font face="georgia, serif" color="#000000">(2) Data elicitation: Human feedback often comes in the form of ratings or rankings (such as pairwise comparisons, triplet comparisons, or total orderings). We introduce a new type of query scheme termed the “perceptual adjustment query” (PAQ), which combines advantages from both ratings and rankings. Operationally, PAQ is implemented by having the user adjust a sliding bar on a continuous spectrum. We showcase PAQ in a metric learning problem, which gives rise to a new matrix estimation problem to which standard estimators cannot be applied. Consequently, we develop a two-stage estimator and provide its sample complexity guarantees, along with simulation and a preliminary user study on a color perception task.</font></span></p><font face="georgia, serif" color="#000000"><br></font></div></div><div style=""><div class="gmail_default"><b><font color="#000000" face="georgia, serif">*********************************************************************************************</font></b></div><p class="MsoNormal" style="margin:0in 0in 8pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:15.6933px"><font face="georgia, serif" color="#000000"><b>Masks are optional in all common areas. </b><b>Full visitor guidance is available at <a href="http://ttic.edu/visitors" target="_blank">ttic.edu/visitors</a>.</b></font></p><p class="MsoNormal" style="margin:0in 0in 12pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;line-height:15.6933px"><b><font color="#000000" face="georgia, serif">*********************************************************************************************</font></b></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><b><i><font color="#000000" face="georgia, serif">Research at TTIC Seminar Series</font></i></b></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif"> </font></p><div class="gmail_default"><div dir="ltr"><div class="gmail_default"><div dir="ltr"><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif" color="#000000">TTIC is hosting a weekly seminar series presenting the research currently underway at the Institute. Every week a different TTIC faculty member will present their research.  The lectures are intended for students seeking research topics and advisors and for the general TTIC and University of Chicago communities interested in hearing what their colleagues are up to.</font></p></div></div></div></div></div></div><font style=""><div><br style="font-family:Arial,Helvetica,sans-serif"></div></font></div><font color="#888888" style="font-size:small;font-family:Arial,Helvetica,sans-serif"><div><br></div><span class="gmail_signature_prefix">--</span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><b><font color="#3d85c6">Brandie Jones </font></b><div><div><div><font color="#3d85c6"><b><i>Executive </i></b></font><b style="color:rgb(61,133,198)"><i>Administrative Assistant</i></b></div></div><div><font color="#3d85c6">Toyota Technological Institute</font></div><div><font color="#3d85c6">6045 S. Kenwood Avenue</font></div><div><font color="#3d85c6">Chicago, IL  60637</font></div></div><div><font color="#3d85c6"><a href="http://www.ttic.edu/" target="_blank">www.ttic.edu</a> </font></div></div></div></font></div><div><br></div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6"><br></font></span></div></div></div></div>