<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:11.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">This is an announcement of Zhuolin Yang Candidacy Exam<o:p></o:p></p>
<p class="MsoNormal">===============================================<o:p></o:p></p>
<p class="MsoNormal"><b>Candidate:</b> Zhuolin Yang<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Date:</b> Friday, September 6th, 2024<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Time:</b> 2:00 pm CST<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Location:</b> JCL 298<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Title:</b> Identifying and Mitigating AI-enhanced Privacy Attacks<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Abstract:</b> Equipped with smartphones, tablets, and virtual reality headsets, we can now perform a wide variety of tasks from virtually anywhere. However, this newfound freedom and flexibility come with its own challenges, particularly
in terms of personal privacy. One emerging threat is sophisticated machine learning (ML) attacks that break privacy assumptions by extracting previously undetectable patterns carried by our daily actions. <o:p></o:p></p>
<p class="MsoNormal">In this talk, I will discuss two of our recent projects on identifying and mitigating real-world privacy threats. First, we identify a general keystroke inference attack in the physical world, where the attacker does not rely on any prior
knowledge or labeled data on the target user or their device. Just by analyzing a 10-min video of the target’s typing hands from meters away, the attacker can extract over 90% of their typed content. This is done by applying a self-supervised learning pipeline
to the video, which curates labeled data from the video and train DNN models to achieve robust inference results. We then extend this attack into virtual reality. By screen-recording the target’s avatar for 10 min, the attacker can also recover the typed content.
This is made possible by the addition of transformer models designed to mitigate digital noise in avatar motion capture. Finally, I will also discuss ongoing projects that explore new forms of privacy attacks in VR systems.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b>Advisors:</b> Ben Zhao and Heather Zheng<o:p></o:p></p>
<p class="MsoNormal"><b>Committee Members:</b> Ben Zhao, Heather Zheng, Pedro Lopes and Grant Ho<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><b> </b><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>