[Colloquium] [Staff] (TOMORROW): Practical Online Learning of In-Network ML Models via a Generative Labeling Agent- Tuesday, October 22th

[Abigail Santana via Colloquium]

UNIVERSITY OF CHICAGO
COMPUTER SCIENCE DEPARTMENT
PRESENTS

Qizheng Zhang
Standford University
PhD Student

AI+System Seminars
Tuesday, October 22th
12:30 pm - 1:30 pm
In Person: John Crerar Library Rm 298 (coffee and cookies will be served)


Title: Practical Online Learning of In-Network ML Models via a Generative Labeling Agent

Abstract: Recent work on in-network machine learning (ML) assumes offline models will perform well in modern networks. However, these models often struggle with fluctuating traffic and network conditions, necessitating frequent online validation and updates. In this talk, I will present Caravan, a practical online learning system for in-network ML. Caravan addresses two key challenges: (a) automatic labeling of evolving traffic and (b) efficient model quality monitoring. By repurposing existing systems like heuristics and foundation models, Caravan generates high-quality labeled data and introduces an “accuracy proxy” metric to track and mitigate model drift. As a case study, I will demonstrate how foundation models (e.g. GPT-4) can be adapted for near real-time labeling of high-volume network traffic.

Bio: Qizheng Zhang is a 3rd-year PhD student at Stanford University. His recent research focus on scaling AI models, including large language models (LLM) serving, high-speed traffic analysis, and video analytics, while addressing key system challenges such as performance optimization, resource management, and reliability. He is also exploring the integration of LLM agents into large-scale systems.

[cid:13dda2a9-e517-4435-a7b3-37717d194330]


Host: Junchen Jiang

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20241021/ba3da03b/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Qizheng Zhang headshot.png
Type: image/png
Size: 70975 bytes
Desc: Qizheng Zhang headshot.png
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20241021/ba3da03b/attachment-0001.png>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ATT00001.txt
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20241021/ba3da03b/attachment-0002.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ATT00002.txt
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20241021/ba3da03b/attachment-0003.txt>