<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">This is an announcement of </span><span class="outlook-search-highlight" style="font-family: Calibri; font-size: 14.666666984558105px; color: rgb(7, 7, 6);">Zhuokai</span><span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;"> </span><span class="outlook-search-highlight" style="font-family: Calibri; font-size: 14.666666984558105px; color: rgb(7, 7, 6);">Zhao</span><span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">'s
Candidacy Exam.</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">===============================================</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Candidate: </span><span class="outlook-search-highlight" style="font-family: Calibri; font-size: 14.666666984558105px; color: rgb(7, 7, 6);">Zhuokai</span><span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;"> </span><span class="outlook-search-highlight" style="font-family: Calibri; font-size: 14.666666984558105px; color: rgb(7, 7, 6);">Zhao</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Date: Thursday, March 28, 2024</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Time: 10 am CT</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Location: JCL 356</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Title: Enhanced Data Utilization for Efficient and Robust Deep Learning Systems</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Abstract: Deep learning (DL) has made significant impacts in many domains, including computer vision (CV), natural language processing
(NLP), recommender systems, and many others. Besides the breakthroughs made to the model architectures, data has been another fundamental factor that significantly impacts the model performance. Such emphasize on data has been widely recognized as data-centric
artificial intelligence (AI). </span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Despite being an emerging concept, studies focusing on developing novel data utilization strategies that boost model performance
without changes to its architecture are still lacking. Therefore, in this thesis, we propose novel data utilization algorithms in both learning and inference schemes within the modern deep learning systems to improve model performance, robustness as well as
develop more well-rounded model evaluations.</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">In the learning scheme, we propose two novel strategies that target both data-scarcity and data-abundance, which are two opposite
dilemma commonly found in vision models when applied to real-world application domains where labeled data is expensive to obtain; and recommender systems where model performance saturates with abundant amount of user-item interaction data. Specifically, the
former is often referred to as active learning (AL), where we propose \textit{Direct Acquisition Optimization} (\dao), a novel AL algorithm that optimizes sample selections based on expected true loss reduction. And for the latter, we propose \textit{User-Centric~Ranking}
(\ucr), an alternative </span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">data formulation strategy that is based on the transposed view of the dyadic user-item interactions.</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">In the inference scheme, we explore how novel data utilization leads to improved model performance and robustness, as well as
more well-rounded model evaluation pipeline, without the need of acquiring new data or conducting additional fine-tuning. Specifically, we introduce \textit{Hallucination Reduction through Adaptive Focal-Contrast decoding} (\halc), a novel decoding strategy
that utilizes fine-grained visual context to help pretrained large vision-language models (LVLMs) mitigate object hallucinations (OH) and produce more trust-worthy outputs. And we develop \textit{Non-Equivariance Revealed on Orbits} (\nero), a novel model
evaluation tool that employs a combination of task-agnostic interactive interface and task-dependent visualizations to intricately evaluate and interpret model behaviors through analyzing its equivariance on purposefully designed data permutations.</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">In summary, this thesis introduces novel data utilization algorithms aimed at enhancing model performance, robustness, and evaluation
in deep learning systems, without altering their architecture. It addresses the challenges of data scarcity and abundance in CV and recommender systems by proposing two learning strategies: \dao for active learning, targeting efficient sample selection, and
\ucr for rethinking data formulation in recommender systems. Additionally, it explores novel inference strategies such as \halc, which improves output trustworthiness of vision-language models by mitigating object hallucinations, and \nero, an evaluation tool
that enhances model interpretability and robustness by analyzing behavior on specially designed data permutations. These contributions highlight the significance of data-centric approaches in advancing deep learning models without necessitating architectural
modifications.</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Advisors: Yuxin Chen</span><br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<br class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">
<span class="" style="caret-color: rgb(33, 33, 33); color: rgb(33, 33, 33); font-family: Calibri; font-size: 14.666666984558105px;">Committee Members: Yuxin Chen, Bo Li, and Michael Maire</span><br class="">
<div class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
<br class="Apple-interchange-newline">
</div>
<br class="">
</body>
</html>