[Colloquium] TODAY (3/23) Shiry Ginosar (UC Berkeley) Toward Artificial Social Intelligence

[Holly Santos]

Department of Computer Science Seminar

Shiry Ginosar
Postdoctoral Fellow
UC Berkeley

Thursday, March 23rd
2:00pm - 3:00pm
In Person: JCL 298

Zoom:
https://uchicagogroup.zoom.us/j/99147021583?pwd=c1J1WUN4VlhXVEVEWEFJRXhNMjFnQT09<https://www.google.com/url?q=https://uchicagogroup.zoom.us/j/99147021583?pwd%3Dc1J1WUN4VlhXVEVEWEFJRXhNMjFnQT09&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw2VLBTJCSZBLKCLa6-SYHfl>

Meeting ID: 991 4702 1583
Passcode: 655609

Title: Toward Artificial Social Intelligence

Abstract:
As the covid pandemic made abundantly clear—multi-faceted, face-to-face interaction is the most effective form of communication—much more so than written text messages or phone calls. And yet, most current AI efforts focus primarily on text systems. In my work, I try to push the limits of machine perception systems toward artificially intelligent agents that can perceive and model the rich, multimodal signals of face-to-face human social interaction: speech and communicative gesture. I will cover several projects that take steps in this direction in the one-to-many scenario of lectures and monologues and one-on-one dyadic face-to-face communication. Through these examples, I will argue that it is possible to model minute, indescribable visual and auditory details of multi-faceted human communication using data-driven methods without relying on annotation. I will then broaden the discussion to questions in social intelligence, such as body language, abstract communicative motion, and spatiotemporal trends of social norms, and suggest directions for future inquiries.

Bio:
Shiry Ginosar is a Computing Innovation Postdoctoral Fellow<https://www.google.com/url?q=https://urldefense.com/v3/__https://cifellows2020.org/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a78MsGif$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw30X3FtU_wk75wb7h0RFGzU> at UC Berkeley<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.eecs.berkeley.edu/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a6h0h4pW$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1cgzz3zfdQTBbHt35Oc5og>, advised by Jitendra Malik<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.eecs.berkeley.edu/*malik/__;fg!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a2WFuLET$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw3rw7TCOLgQG1ZYeGA5CW8G>. She completed her Ph.D. in Computer Science at UC Berkeley<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.berkeley.edu/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a22LM0XM$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw31lYfjgw02W5TIsQd8LuUf>, under the supervision of Alyosha Efros<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.eecs.berkeley.edu/*efros/__;fg!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83awzctaen$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw0etBgl6hnO2MxWsiWEshdL>. Prior to joining the Computer Vision group, she was part of Bjoern Hartmann<https://www.google.com/url?q=https://urldefense.com/v3/__https://people.eecs.berkeley.edu/*bjoern/__;fg!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83axTyhBRe$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1mNNBZ70696pcEa8nvcPhe>'s Human-Computer Interaction lab at Berkeley. Earlier in her career, she was a Visiting Scholar at the CS Department<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.cs.cmu.edu/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a7fBFcyP$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw0xA5jOvlmjQHxzX6TOaR_7> of Carnegie Mellon University<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.cmu.edu/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a3rzjabX$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw14EhXwjJwUgEY6qgPwJA65>, with Luis von Ahn<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.cs.cmu.edu/*biglou__;fg!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a1T3Rkrv$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw3Vfn14_Jcnaukg-0eUZW9Q> and Manuel Blum<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.cs.cmu.edu/*mblum/__;fg!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83axYOFeMY$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1imjVfF3Fizy9c4ncgemBc> in the field of Human Computation<https://www.google.com/url?q=https://urldefense.com/v3/__http://en.wikipedia.org/wiki/Human-based_computation__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83azGMFwka$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1dwR512Z57DmN8NOhVQI1N>. Between her academic roles, she spent four years at Endeca<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.endeca.com/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a0dqhSWV$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw3p7DPRcG6fIeyQUfeOdhTQ> as a Senior Software Engineer. In her distant past, Shiry trained fighter pilots in F-4 Phantom<https://www.google.com/url?q=https://urldefense.com/v3/__https://en.wikipedia.org/wiki/McDonnell_Douglas_F-4_Phantom_II__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a6qSLxcU$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1Dg9Xfm2nnExL5uDNet_71> flight simulators as a Staff Sergeant in the Israeli Air Force. Shiry’s research has been covered by The New Yorker<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.newyorker.com/magazine/2018/11/12/in-the-age-of-ai-is-seeing-still-believing__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a5Vq4G3j$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw1Da5ail_cu43rT7JAZbx9o>, The Wall Street Journal<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.wsj.com/articles/deepfake-videos-are-ruining-lives-is-democracy-next-1539595787__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a6PeHqNC$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw0WZUW1FeHD_zmQju521BZC>, and the Washington Post<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.washingtonpost.com/news/wonk/wp/2015/12/01/researchers-have-discovered-a-surprising-reason-we-smile-in-photos/?noredirect%3Don%26utm_term%3D.5e52a9d6fa4b__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83ax1iiotF$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw3maCVc_mu3SxLYSJQuVWqZ>, amongst others. Her work has been featured on PBS NOVA<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.pbs.org/video/deepfake-videos-are-getting-terrifyingly-real-xywbdx/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a92WzJAO$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw2kdFYbwWEtsNn1MaswT4wW>, exhibited at the Israeli Design Museum<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.dmh.org.il/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a_ox34tT$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw270d99PpgICX0FzthCJ_Vb> and is part of the permanent collection of the Deutsches Museum<https://www.google.com/url?q=https://urldefense.com/v3/__https://www.deutsches-museum.de/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a5-pTd9b$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw0nMBGSUqpCs6jk35Wuhe4j>. Her patent-pending research work inspired the founding of a startup<https://www.google.com/url?q=https://urldefense.com/v3/__https://apps.apple.com/us/app/sway-magic-dance/id1441466995__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a4yAAsfv$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw0hUdg2vDocQFw4U5gXJsHd>. Shiry has been named a Rising Star in EECS<https://www.google.com/url?q=https://urldefense.com/v3/__https://publish.illinois.edu/rising-stars/participants/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a6VJOmID$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw32XqoJh3qLANMGg7aCREAM>, and is a recipient of the NSF Graduate Research Fellowship<https://www.google.com/url?q=https://urldefense.com/v3/__http://www.nsfgrfp.org/__;!!BpyFHLRN4TMTrA!4w4re3bMNvEGIbRp50vNLl1Dubb6WQHvBWg-SivszYtZqnuWzv4db-dx1mYTOXYcIgTMc2AL_fi5bk83a7QJ97tR$&sa=D&source=calendar&ust=1679405110362052&usg=AOvVaw2gHENfRC1TKNE_7AcPJ3hH>, the California Legislature Grant for graduate studies, and the Samuel Silver Memorial Scholarship Award for combining intellectual achievement in science and engineering with serious humanistic and cultural interests.

[777F9347-CA65-4E88-B3DA-5430FC6BA2AE.png]

---
Holly Santos
Executive Assistant to Michael J. Franklin, Chairman
Department of Computer Science
The University of Chicago
5730 S Ellis Ave-217   Chicago, IL 60637
P: 773-834-8977
hsantos at uchicago.edu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20230323/0c54fbf1/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 777F9347-CA65-4E88-B3DA-5430FC6BA2AE.png
Type: image/png
Size: 88694 bytes
Desc: 777F9347-CA65-4E88-B3DA-5430FC6BA2AE.png
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20230323/0c54fbf1/attachment-0001.png>