<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div><div class="" style="font-family: Calibri, sans-serif; font-size: 11pt; margin: 0in 0in 0.0001pt; line-height: 16.866666793823242px;"><div style="margin: 0in 0in 0.0001pt; font-size: 12pt;" class=""><div class="" style="font-family: Helvetica; font-size: 12px;"><div class=""><br class=""></div></div></div></div></div></div></div>
</div>
<div><br class=""><blockquote type="cite" class=""><div class="">Begin forwarded message:</div><br class="Apple-interchange-newline"><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">From: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class="">Sandra Wallace <<a href="mailto:swallace@cs.uchicago.edu" class="">swallace@cs.uchicago.edu</a>><br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">Subject: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class=""><b class="">CS Seminar today at 3 pm: Steve Hanneke, TTIC</b><br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">Date: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class="">February 15, 2021 at 7:00:06 AM CST<br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">To: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class=""><a href="mailto:colloquium@cs.uchicago.edu" class="">colloquium@cs.uchicago.edu</a>, <a href="mailto:undergrads@mailman.cs.uchicago.edu" class="">undergrads@mailman.cs.uchicago.edu</a>, <a href="mailto:masters-students@cs.uchicago.edu" class="">masters-students@cs.uchicago.edu</a><br class=""></span></div><br class=""><div class=""><meta http-equiv="Content-Type" content="text/html; charset=us-ascii" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><span class="" style="orphans: 2; widows: 2; font-size: large;">UNIVERSITY OF CHICAGO</span></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><span class=""><font size="4" class="">DEPARTMENT OF COMPUTER SCIENCE</font></span></div><div class="" style="orphans: 2; widows: 2;"><span class=""><font size="4" class="">PRESENTS</font></span></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div class=""><br class="webkit-block-placeholder"></div><p class="MsoNormal"><o:p class=""> </o:p><img apple-inline="yes" id="926E7C99-F553-47BB-A099-BDB26F75795D" class="" src="cid:413F637C-A12C-4347-9570-3A587DFE7123"></p><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class="" style="orphans: 2; widows: 2;"><font class="" size="4"><b class="">Steve Hanneke</b></font></div><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div dir="auto" class="" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class="" style="orphans: 2; widows: 2;"><div class="" style="margin: 0in 0in 0.0001pt;"><font class="" size="4"><i class="">Toyota Technological Institute at Chicago</i></font></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><i class=""><p class="MsoNormal" align="center"><font size="4" class=""><o:p class=""></o:p></font></p></i></span><div class=""><font size="4" class=""><br class=""></font></div></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><span class=""><font class=""><font class="" size="4"><b class="">Monday, February 15th at 3:00 pm</b></font></font></span></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><br class=""></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><span class="" style="font-size: 15px;">Join via zoom (enables questions):</span></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class="" style="font-size: 15px;"><a href="https://uchicago.zoom.us/j/94749223374?pwd=OGloa29RWlBMKzA0MVMyekd2UU1sUT09" class="">https://uchicago.zoom.us/j/94749223374?pwd=OGloa29RWlBMKzA0MVMyekd2UU1sUT09</a><br class="">Passcode: uccs2021<span class=""><br class=""> </span></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><span class="" style="font-size: 15px;">Or</span></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><span class=""><span class="" style="font-size: 15px;"><br class="">Watch via live stream:<br class=""></span></span></div><div class="" style="margin: 0in 0in 0.0001pt;"><a href="http://live.cs.uchicago.edu/stevehanneke/" class="" style="font-size: 15px;">http://live.cs.uchicago.edu/stevehanneke/</a></div></div><div class=""><div class=""><font size="4" class=""><font class=""><span class=""><b class="" style="color: rgb(33, 33, 33);"><br class=""></b></span></font></font></div><div class=""><span class="" style="font-size: 15px;"><font class=""><font class=""><span class=""><b class="" style="color: rgb(33, 33, 33);">Title: </b></span></font></font><font color="#212121" class=""><span class=""><b class="">Machine Learning Theory Beyond Uniform Convergence</b></span></font></span></div><div class=""><font color="#212121" class=""><span class="" style="font-size: 15px;"><b class=""><br class=""></b></span></font></div><div class=""><span class="" style="font-size: 15px;"><span class="" style="color: rgb(33, 33, 33);"><b class=""><font class="">Abstract: </font></b></span><font color="#212121" class=""><span class="">For over 50 years, statistical learning theory has developed largely based on the "uniform convergence" principle: for any model that is not too complex, a learner's performance on the training data is a good indicator of its expected performance on future yet-unseen examples. Uniform convergence motivates a natural learning strategy, known as Empirical Risk Minimization (ERM), where an algorithm simply optimizes over the model parameters to fit the training data as well as possible. While these ideas have led to powerful and beautiful theories, recent works have revealed limitations of uniform convergence for understanding the performance of certain learning algorithms, and of ERM as a viable approach to achieving certain desirable performance criteria. These observations reveal a need for new approaches to the design and analysis of machine learning algorithms. In this talk, I present a few examples from my recent work.</span></font></span></div><font color="#212121" class=""><span class="" style="font-size: 15px;"><br class="">As a first example, we consider rates of convergence of an algorithm's generalization error as a function of number of training examples. Our work provides a complete characterization of the optimal rates of convergence. However, the rates achievable by general ERM learners can be suboptimal by an arbitrarily large gap. Rather than uniform convergence, our optimal learner is based on solutions of a game-theoretic interpretation of the learning problem.<br class=""><br class="">As another example, it is known that many learning algorithms are unstable, in the sense that even if they are correct on a given test example, an adversary can change the learner's prediction by perturbing the example an imperceptible amount. Our work reveals that the natural ERM approach to addressing this, known as "adversarial training", can fail spectacularly. However, approaching the problem from a different perspective, not relying on uniform convergence, we propose a new learning algorithm that is provably robust to such adversarial attacks. <br class=""><br class="">I will conclude with some ongoing work toward a general theory of data-dependent generalization bounds, yielding performance guarantees for certain learning algorithms where there is no corresponding bounded-capacity hypothesis class to which traditional uniform convergence arguments could be applied.<br class=""><br class="">Based on various joint works with Olivier Bousquet, Omar Montasser, Shay Moran, Nathan Srebro, Ramon van Handel, and Amir Yehudayoff.</span></font><div class=""><font class=""><span class=""><div class="" style="font-variant-ligatures: normal; background-color: rgb(255, 255, 255);"><div class=""><span class="" style="font-size: 15px;"><font class=""><span class=""><span id="docs-internal-guid-bf351367-7fff-5067-8c8e-0130cc54a81c" class=""><div class="" style="line-height: 1.38; margin-top: 0pt; margin-bottom: 0pt;"><span class=""><span class=""><span class=""><span class=""><span class="" style="white-space: pre-wrap;"><br class=""></span></span></span></span></span></div></span></span><b class="" style="color: rgb(33, 33, 33);">Bio: </b></font><font color="#222222" class=""><span class="">Steve Hanneke is a Research Assistant Professor at the Toyota Technological Institute at Chicago. His research explores the theory of machine learning, with a focus on reducing the number of training examples sufficient for learning. His work develops new approaches to supervised, semi-supervised, active, and transfer learning, and also revisits the basic probabilistic assumptions at the foundation of learning theory. Steve earned a Bachelor of Science degree in Computer Science from UIUC in 2005 and a Ph.D. in Machine Learning from Carnegie Mellon University in 2009 with a dissertation on the theoretical foundations of active learning.</span></font></span></div><div class=""><font color="#222222" class=""><span class="" style="font-size: 15px;"><br class=""></span></font></div></div></span></font></div><div class=""><div class="" style="font-variant-ligatures: normal; background-color: rgb(255, 255, 255);"><font color="#222222" class=""><i class=""><b class=""><font class="" style="font-size: 15px;">Host: Rebecca Willett</font></b></i></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></blockquote></div><br class=""></body></html>