<div dir="ltr">Hey all, <div>Just a reminder that this is today at 11 am (not our usual slot)! </div><div><br></div><div>Sanjay</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Apr 4, 2019 at 6:54 PM Sandra Wallace <<a href="mailto:swallace@cs.uchicago.edu">swallace@cs.uchicago.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div><span style="font-size:15px"><span>UNIVERSITY OF CHICAGO</span><br><span>DEPARTMENT OF COMPUTER SCIENCE</span></span></div><div><span style="font-size:15px">PRESENTS</span></div><div><span style="font-size:14px"><br></span></div><div><span style="font-size:14px"></span></div></div></div></div></div><span id="gmail-m_-8554808596196837998docs-internal-guid-de668218-7fff-220a-42c4-c3d01efd7aaf" style="font-family:-webkit-standard"><div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"></div></span><span style="font-size:12pt;font-family:Helvetica,sans-serif"></span></div></div></div><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"></div></div></div></div></div></div></div>
</div><div style="overflow-wrap: break-word;"><br><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><br><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div><span style="font-size:14px"></span></div><div></div></div></div></div></div><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div><div style="margin:0in 0in 0.0001pt"><b><font size="4">Alexey Tumanov</font></b></div><div style="margin:0in 0in 0.0001pt"><span style="font-size:14px"><i>UC Berkeley<br></i></span><div><span style="font-size:14px"><i><span class="gmail-m_-8554808596196837998Apple-tab-span" style="white-space:pre-wrap"> </span></i></span></div></div><div style="margin:0in 0in 0.0001pt"><b><font style="font-size:14px"><br></font></b></div><div style="margin:0in 0in 0.0001pt"><span><b><font size="4">Friday, April 12, 2019 at 11:00 am<br>Crerar 390</font></b><br></span></div></div><div><span style="font-size:14px"><br></span></div><div><br></div><div><div><font size="3"><font><span><b style="color:rgb(33,33,33)">Title: </b></span></font><b style="text-align:center">Resource Management and Scheduling for Emerging AI Applications</b></font></div><div style="color:rgb(33,33,33)"><b><font style="font-size:15px"><br></font></b></div><div style="color:rgb(33,33,33)"><b><font style="font-size:15px">Abstract:</font></b></div><div><font><span><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><div><font><span><span id="gmail-m_-8554808596196837998docs-internal-guid-bf351367-7fff-5067-8c8e-0130cc54a81c"><div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span><span><span><span><span style="font-size:15px;white-space:pre-wrap">A new class of Artificial Intelligence applications is emerging that imposes a challenging set of requirements on how we program the cloud and how we manage cloud resources efficiently. With the end of Moore’s Law and Dennard scaling, coupled with simultaneous increase in the heterogeneity of increasingly interactive AI applications with end-to-end latency constraints, the future of AI Systems depends on advances in resource management and scheduling for these applications. First, these applications generate an increasingly heterogeneous set of tasks, both in the resources optimal for their performance and in the time scale of individual tasks. Second, they are increasingly user-facing, imposing a set of soft real-time constraints on the frameworks serving these workloads. Third, they individually expect or benefit from heterogeneous and often conflicting resource allocation policies --- a challenge for unifying frameworks that aim to support them. Thus, a set of three emergent requirements must be efficiently addressed: (1) heterogeneity awareness in space and time, (2) soft real-time end-to-end latency constraints, and (3) scheduling policy heterogeneity at the application level. To address these requirements, I will present (1) TetriSched --- a mathematical framework to capture the performance as a function of resource space and timeliness requirements of these applications for cost-efficient and heterogeneity-aware resource allocation, (2) Inferline --- a soft real-time system for achieving these requirements under unpredictable bursty workloads when multiple ML models are composed for inference; (3) Ray --- an active open source project that brings some of these ideas together and serves as the unifying framework for distributed ML, addressing the challenge of scheduling policy heterogeneity.</span><br><br><span style="font-size:15px;white-space:pre-wrap"> </span></span></span><br></span></span></div></span></span><b style="font-size:15px;color:rgb(33,33,33)">Bio:</b></font></div></div></span></font></div><div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i>Alexey Tumanov is a Postdoctoral Researcher at the University of California Berkeley, working with Ion Stoica and collaborating closely with Joseph Gonzalez in RISELab, Department of Computer Science. Alexey completed his Ph.D. at Carnegie Mellon University, advised by Gregory Ganger. At Carnegie Mellon, Alexey was awarded the prestigious Canadian government fellowship, NSERC Alexander Graham Bell Canada Graduate Scholarship (NSERC CGS-D3) and was a member of the Intel Science and Technology Center for Cloud Computing and the Parallel Data Lab. Alexey’s Systems research spanned the entire stack, starting with agile stateful VM replication with para-virtualization at the University of Toronto (working with Eyal de Lara) and most recently involving resource management for emerging AI applications. Alexey is the recipient of several awards, including the Best Graduate Student Teaching Assistant at Carnegie Mellon and the Best Student Paper award for his thesis work on TetriSched at EuroSys 2016.</i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><br></i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b>Host: Sanjay Krishnan</b></i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b><br></b></i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b>PDF:</b></i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b><br></b></i></span></font></div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b></b></i></span></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div dir="auto" style="overflow-wrap: break-word;"><div><div><div style="font-variant-ligatures:normal;background-color:rgb(255,255,255)"><font color="#222222"><span style="font-size:15px"><i><b></b></i></span></font></div><div><font color="#222222"><span style="font-size:15px"><i><b><br></b></i></span></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>_______________________________________________<br>
Colloquium mailing list - <a href="mailto:Colloquium@mailman.cs.uchicago.edu" target="_blank">Colloquium@mailman.cs.uchicago.edu</a><br>
<a href="https://mailman.cs.uchicago.edu/mailman/listinfo/colloquium" rel="noreferrer" target="_blank">https://mailman.cs.uchicago.edu/mailman/listinfo/colloquium</a><br>
_______________________________________________<br>
faculty mailing list - <a href="mailto:faculty@mailman.cs.uchicago.edu" target="_blank">faculty@mailman.cs.uchicago.edu</a><br>
<a href="https://mailman.cs.uchicago.edu/mailman/listinfo/faculty" rel="noreferrer" target="_blank">https://mailman.cs.uchicago.edu/mailman/listinfo/faculty</a><br>
_______________________________________________<br>
assistant-professors mailing list<br>
<a href="mailto:assistant-professors@mailman.cs.uchicago.edu" target="_blank">assistant-professors@mailman.cs.uchicago.edu</a><br>
<a href="https://mailman.cs.uchicago.edu/cgi-bin/mailman/listinfo/assistant-professors" rel="noreferrer" target="_blank">https://mailman.cs.uchicago.edu/cgi-bin/mailman/listinfo/assistant-professors</a><br>
</blockquote></div>