<div dir="ltr"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style=""><div dir="ltr" style="font-size:small"><div class="gmail_default"><b style="font-family:verdana,sans-serif;font-size:large;color:rgb(80,0,80);background-color:rgb(207,226,243)">Thesis Defense: Nicholas Kolkin, TTIC</b><br></div></div><div dir="ltr" style=""><div style=""><div style=""><div style="font-size:small;color:rgb(80,0,80);font-family:arial,helvetica,sans-serif"><br></div><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">When:  </span></b><span style="color:black">     Monday<b>,</b> July 12th at <b><span style="background:yellow">9:00 - 11:00 am CT</span></b></span></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black">      TTIC,<b><i> </i></b>6045 S. Kenwood Avenue, 5th floor, Room 530</span></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><br></span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" style="font-size:small"><span style="color:black;background-color:rgb(255,255,0)"><b><span class="gmail_default"></span></b></span></font><font face="arial, sans-serif" style="font-size:small"><span style="color:black;background-color:rgb(255,255,0)"><b>Note:</b> </span></font><b style="font-size:small">       </b><font face="arial, sans-serif" style=""><b style=""> </b>At the moment the in-person attendance list is full, so please plan to attend remotely if you have not signed up.</font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><span style="font-family:arial,sans-serif"><br></span></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font size="1"><span style="font-family:arial,sans-serif">There is </span><b style="font-family:arial,sans-serif">limited in-person attendance for fully vaccinated persons</b><span style="font-family:arial,sans-serif">. </span></font></p><div style=""><font size="1"><font face="arial, sans-serif"><i><u>For members of TTIC community:</u> </i>if you would like to attend, please sign up specifically in the "Nick's defense" section at the bottom of the July 12 column in the TTIC spreadsheet, by adding your name and entering "1". You can do so as long as capacity does not exceed 15. Please only sign up in that section (and do not also mark "1" in the normal row for your name) to keep the total in-person count correct.</font>  <a href="https://docs.google.com/spreadsheets/d/1riLfzATcp6NDH0mReGZxpvevfc6Yi2apJ-Ye4uZU62A/edit#gid=1351650168" target="_blank"><b>https://docs.google.com/spreadsheets/d/1riLfzATcp6NDH0mReGZxpvevfc6Yi2apJ-Ye4uZU62A/edit#gid=1351650168</b></a></font></div><div style=""><font face="arial, sans-serif" size="1"><font color="#000000"><i><u>For people outside TTIC:</u></i> if you are interested to attend please contact Greg Shakhnarovich</font><font color="#500050">, </font><font color="#0000ff"><a href="mailto:greg@ttic.edu" target="_blank">greg@ttic.edu</a>.</font></font></div><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" size="1" style=""> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><b>Virtually: </b>  </span><b><u><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_l4Hez5bZQKmjtjL2ZSbRtQ" target="_blank">Register in advance here</a></span></u></b></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black">       <span class="gmail_default"> </span>Nicholas Kolkin, TTIC</span></font><span style="font-family:Arial,sans-serif;font-size:12pt"></span></p></div><div style="font-size:small"><font color="#000000"><br></font></div><div style="font-size:small"><font color="#000000"><br></font></div><div style="font-size:small"><div><font face="arial, sans-serif" color="#000000"><b>Title:        </b></font>Non-Parametric Neural Style Transfer</div><font face="arial, sans-serif" color="#000000"><br></font><div><div><font face="arial, sans-serif"><font color="#000000"><b>Abstract:  </b></font></font>It seems easy to imagine a photograph of the Eiffel Tower painted in the style of Vincent van Gogh's 'The Starry Night', but upon introspection it is difficult to precisely define what this would entail. What visual elements must an image contain to represent the 'content' of the Eiffel Tower? What visual elements of 'The Starry Night' are caused by van Gogh's 'style' rather than his decision to depict a village under the night sky? Precisely defining 'content' and 'style' is a central challenge of designing algorithms for artistic style transfer, algorithms which can recreate photographs using an artwork's style. My efforts defining these terms, and designing style transfer algorithms themselves, are the focus of this thesis. I will begin by proposing novel definitions of style and content based on optimal transport and self-similarity, and demonstrating how a style transfer algorithm based on these definitions generates outputs with improved visual quality. Then I will describe how the traditional texture-based definition of style can be expanded to include elements of geometry and proportion by jointly optimizing a keypoint-guided deformation field alongside the stylized output's pixels. Finally I will describe a framework inspired by both modern neural style transfer algorithms and traditional patch-based synthesis approaches which is fast, general, and offers state-of-the-art visual quality.</div></div></div><div style="font-size:small"><br></div><div style="font-size:small"><font face="arial, sans-serif"><br></font></div><font face="arial, sans-serif" style="font-size:small"><b><font color="#000000">Thesis Advisor:</font></b><font color="#500050"> </font><a href="mailto:greg@ttic.edu" target="_blank"><b><font color="#0000ff">Greg Shakhnarovich</font></b></a></font><br clear="all"></div><div style="font-size:small"><div dir="ltr"><div dir="ltr"><font face="arial, helvetica, sans-serif" size="1"></font><div><font face="arial, helvetica, sans-serif" size="1"><br></font></div><div><div><br></div></div><div><br></div><div><br><br></div></div></div></div></div></div><div><div dir="ltr" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="font-family:arial,helvetica,sans-serif;font-size:x-small">Mary C. Marre</span><br></div><div><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br></div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jul 7, 2021 at 3:41 PM Mary Marre <<a href="mailto:mmarre@ttic.edu" target="_blank">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div style="font-size:small"><b style="font-family:verdana,sans-serif;font-size:large;color:rgb(80,0,80);background-color:rgb(207,226,243)">Thesis Defense: Nicholas Kolkin, TTIC</b><br></div></div><div dir="ltr"><div style="font-size:small"><div><div><div style="color:rgb(80,0,80);font-family:arial,helvetica,sans-serif"><br></div><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">When:  </span></b><span style="color:black">     Monday<b>,</b> July 12th at <b><span style="background:yellow">9:00 - 11:00 am CT</span></b></span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black">      TTIC,<b><i> </i></b>6045 S. Kenwood Avenue, 5th floor, Room 530</span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><br></span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black;background-color:rgb(255,255,0)"><b><span class="gmail_default" style="font-size:small"></span></b></span></font><font face="arial, sans-serif"><span style="color:black;background-color:rgb(255,255,0)"><b>Note:</b> </span></font><b>       </b><b> </b><font face="arial, sans-serif">There will be <b>limited in-person attendance for fully vaccinated persons</b>. </font></p><div><font face="arial, sans-serif"><i><u>For members of TTIC community:</u> </i>if you would like to attend, please sign up specifically in the "Nick's defense" section at the bottom of the July 12 column in the TTIC spreadsheet, by adding your name and entering "1". You can do so as long as capacity does not exceed 15. Please only sign up in that section (and do not also mark "1" in the normal row for your name) to keep the total in-person count correct.</font>  <a href="https://docs.google.com/spreadsheets/d/1riLfzATcp6NDH0mReGZxpvevfc6Yi2apJ-Ye4uZU62A/edit#gid=1351650168" target="_blank"><font size="1"><b>https://docs.google.com/spreadsheets/d/1riLfzATcp6NDH0mReGZxpvevfc6Yi2apJ-Ye4uZU62A/edit#gid=1351650168</b></font></a></div><span><div><font face="arial, sans-serif"><font color="#000000"><i><u>For people outside TTIC:</u></i> if you are interested to attend please contact Greg Shakhnarovich</font><font color="#500050">, </font><font color="#0000ff"><a href="mailto:greg@ttic.edu" target="_blank">greg@ttic.edu</a>.</font></font></div></span><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" size="1"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><b>Virtually: </b>  </span><b><u><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_l4Hez5bZQKmjtjL2ZSbRtQ" target="_blank">Register in advance here</a></span></u></b></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black">       <span class="gmail_default" style="font-size:small"> </span>Nicholas Kolkin, TTIC</span></font><span style="font-family:Arial,sans-serif;font-size:12pt"></span></p></div><div><font color="#000000"><br></font></div><div><font color="#000000"><br></font></div><div><div><font face="arial, sans-serif" color="#000000"><b>Title:        </b></font>Non-Parametric Neural Style Transfer</div><font face="arial, sans-serif" color="#000000"><br></font><div><div><font face="arial, sans-serif"><font color="#000000"><b>Abstract:  </b></font></font>It seems easy to imagine a photograph of the Eiffel Tower painted in the style of Vincent van Gogh's 'The Starry Night', but upon introspection it is difficult to precisely define what this would entail. What visual elements must an image contain to represent the 'content' of the Eiffel Tower? What visual elements of 'The Starry Night' are caused by van Gogh's 'style' rather than his decision to depict a village under the night sky? Precisely defining 'content' and 'style' is a central challenge of designing algorithms for artistic style transfer, algorithms which can recreate photographs using an artwork's style. My efforts defining these terms, and designing style transfer algorithms themselves, are the focus of this thesis. I will begin by proposing novel definitions of style and content based on optimal transport and self-similarity, and demonstrating how a style transfer algorithm based on these definitions generates outputs with improved visual quality. Then I will describe how the traditional texture-based definition of style can be expanded to include elements of geometry and proportion by jointly optimizing a keypoint-guided deformation field alongside the stylized output's pixels. Finally I will describe a framework inspired by both modern neural style transfer algorithms and traditional patch-based synthesis approaches which is fast, general, and offers state-of-the-art visual quality.</div></div></div><div><br></div><div><font face="arial, sans-serif"><br></font></div><font face="arial, sans-serif"><b><font color="#000000">Thesis Advisor:</font></b><font color="#500050"> </font><a href="mailto:greg@ttic.edu" target="_blank"><b><font color="#0000ff">Greg Shakhnarovich</font></b></a></font><br clear="all"></div><div><div dir="ltr"><div dir="ltr"><font face="arial, helvetica, sans-serif" size="1"></font><div><font face="arial, helvetica, sans-serif" size="1"><br></font></div><div><div><br></div></div><div><br></div></div></div></div></div><div><div dir="ltr"><div dir="ltr"><div><font face="arial, helvetica, sans-serif" size="1">Mary C. Marre</font><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jun 29, 2021 at 11:38 AM Mary Marre <<a href="mailto:mmarre@ttic.edu" target="_blank">mmarre@ttic.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div style="font-size:small;color:rgb(80,0,80)"><font face="verdana, sans-serif" size="4"><span style="background-color:rgb(207,226,243)"><b>Thesis Defense: Nicholas Kolkin, TTIC</b></span></font><br></div><div style="font-size:small;color:rgb(80,0,80);font-family:arial,helvetica,sans-serif"><br></div><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">When:  </span></b><span style="color:black">     Monday<b>,</b> July 12th at <b><span style="background:yellow">9:00 - 11:00 am CT</span></b></span></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Where:</span></b><span style="color:black">      TTIC,<b><i> </i></b>6045 S. Kenwood Avenue, 5th floor, Room 530</span></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><br></span></font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" style="font-size:small"><span style="color:black;background-color:rgb(255,255,0)"><b>Note:</b> </span></font><span style="background-color:rgb(255,255,255)"><b style="font-size:small">       </b><font size="1"><b> </b>I</font></span><font size="1">n person attendance will be limited and require sign up. More details to follow.</font></p><p class="MsoNormal" style="margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif" size="1"> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><span style="color:black"><b>Virtually: </b>  </span><b><u><span style="color:blue"><a href="https://uchicagogroup.zoom.us/webinar/register/WN_l4Hez5bZQKmjtjL2ZSbRtQ" target="_blank">Register in advance here</a></span></u></b></font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"> </font></p><p class="MsoNormal" style="font-size:small;margin:0in;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial"><font face="arial, sans-serif"><b><span style="color:black">Who: </span></b><span style="color:black">       Nicholas Kolkin, TTIC</span></font><span style="font-family:Arial,sans-serif;font-size:12pt"></span></p></div><div style="font-size:small"><font color="#000000"><br></font></div><div style="font-size:small"><font color="#000000"><br></font></div><div style="font-size:small"><div><font face="arial, sans-serif" color="#000000"><b>Title:        </b></font>Non-Parametric Neural Style Transfer</div><font face="arial, sans-serif" color="#000000"><br></font><div><div><font face="arial, sans-serif"><font color="#000000"><b>Abstract:  </b></font></font>It seems easy to imagine a photograph of the Eiffel Tower painted in the style of Vincent van Gogh's 'The Starry Night', but upon introspection it is difficult to precisely define what this would entail. What visual elements must an image contain to represent the 'content' of the Eiffel Tower? What visual elements of 'The Starry Night' are caused by van Gogh's 'style' rather than his decision to depict a village under the night sky? Precisely defining 'content' and 'style' is a central challenge of designing algorithms for artistic style transfer, algorithms which can recreate photographs using an artwork's style. My efforts defining these terms, and designing style transfer algorithms themselves, are the focus of this thesis. I will begin by proposing novel definitions of style and content based on optimal transport and self-similarity, and demonstrating how a style transfer algorithm based on these definitions generates outputs with improved visual quality. Then I will describe how the traditional texture-based definition of style can be expanded to include elements of geometry and proportion by jointly optimizing a keypoint-guided deformation field alongside the stylized output's pixels. Finally I will describe a framework inspired by both modern neural style transfer algorithms and traditional patch-based synthesis approaches which is fast, general, and offers state-of-the-art visual quality.</div></div></div><div style="font-size:small"><br></div><div style="font-size:small"><font face="arial, sans-serif"><br></font></div><font face="arial, sans-serif" style="font-size:small"><b><font color="#000000">Thesis Advisor:</font></b><font color="#500050"> </font><a href="mailto:greg@ttic.edu" target="_blank"><b><font color="#0000ff">Greg Shakhnarovich</font></b></a></font><br clear="all"></div><div><div dir="ltr"><div dir="ltr"><font face="arial, helvetica, sans-serif" size="1"><span></span></font><div><font face="arial, helvetica, sans-serif" size="1"><br></font></div><div><div style="font-size:small"><br></div><br></div><div><font face="arial, helvetica, sans-serif" size="1"><br></font></div><div><font face="arial, helvetica, sans-serif" size="1">Mary C. Marre</font><div><font face="arial, helvetica, sans-serif" size="1">Faculty Administrative Support</font></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1"><b>Toyota Technological Institute</b></font></i></div><div><i><font face="arial, helvetica, sans-serif" color="#3d85c6" size="1">6045 S. Kenwood Avenue</font></i></div><div><font size="1"><i><font face="arial, helvetica, sans-serif" color="#3d85c6">Chicago, IL  60637</font></i><br></font></div><div><b><i><a href="mailto:mmarre@ttic.edu" target="_blank"><font face="arial, helvetica, sans-serif" size="1">mmarre@ttic.edu</font></a></i></b></div></div></div></div></div></div>
</blockquote></div>
</div>
</blockquote></div>
</div>