<div dir="ltr"><div class="gmail_default" style="font-family:georgia,serif;font-size:small"><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>When:</b>        Monday, October 3rd at <b style="background-color:rgb(255,255,0)">11:30am CT</b></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><br></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>Where:      </b><font color="#000000">Talk will be given<span style="background-color:rgb(255,255,0)"> </span></font><font color="#000000"><font style="font-weight:bold"><u style="background-color:rgb(255,255,0)">live, in-person</u></font><font style="font-weight:bold"> </font>at</font></font></div><p class="MsoNormal" style="margin:0in;font-family:Arial,Helvetica,sans-serif;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="georgia, serif"><font color="#500050">               </font><font color="#000000">    <span class="gmail_default">   </span>TTIC, 6045 S. Kenwood Avenue</font></font></p><p class="MsoNormal" style="margin:0in;font-family:Arial,Helvetica,sans-serif;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font color="#000000" face="georgia, serif">                   <span class="gmail_default">   </span>5th Floor, Room 530<b> </b></font></p><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><br></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>Virtually: </b>via Panopto (<a href="https://uchicago.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=d75fa37a-c24c-4dda-a193-af1901495c36" target="_blank">Join Here</a>) </font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><br></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>Who:          </b>John C. Duchi, Stanford University </font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><br></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>Title:</b>          How many labelers do you have? Some perspectives on "gold standard" labels</font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><br></font></div><div class="gmail_default" style="font-family:Arial,Helvetica,sans-serif"><font face="georgia, serif"><b>Abstract: </b>The construction of most supervised learning datasets revolves around collecting multiple labels for each instance, then aggregating the labels to form a type of “gold-standard” label. We question the wisdom of this pipeline by developing a (stylized) model of this process and analyzing its statistical consequences, showing how access to non-aggregated label information can make training well-calibrated models easier or—in some cases—even feasible, whereas it is impossible with only gold-standard labels. The entire story, however, is subtle, and the contrasts between aggregated and fuller label information depend on the particulars of the problem. The theory we develop in the stylized model makes several predictions for real-world datasets, including when non-aggregate labels should improve learning performance, which we carefully test to corroborate the validity of our predictions.</font></div><font face="georgia, serif"><br>Based on joint work with Chen Cheng and Hilal Asi</font><div class="gmail_default"><br></div><div class="gmail_default"><b>Host: <a href="mailto:nati@ttic.edu" target="_blank">Nathan Srebro</a></b></div><div class="gmail_default"><br></div><div class="gmail_default"><br></div></div><div><br></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><b style="background-color:rgb(255,255,255)"><font color="#3d85c6">Brandie Jones </font></b><div><div><i><b style="background-color:rgb(255,255,255)"><font color="#3d85c6">Administrative Assistant</font></b></i></div><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6">Toyota Technological Institute</font></span></div><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6">6045 S. Kenwood Avenue</font></span></div><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6">Chicago, IL  60637</font></span></div></div><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6"><a href="http://www.ttic.edu" target="_blank">www.ttic.edu</a> </font></span></div><div><span style="background-color:rgb(255,255,255)"><font color="#3d85c6"><br></font></span></div><div><font color="#3d85c6"><div style="background-color:rgb(238,238,238)">Working Remote on Tuesdays</div></font></div></div></div></div>