[Colloquium] NOW JCL 298 Haozhi Qi (UC Berkeley) Multisensory Dexterity for Robotics

[Holly Santos via Colloquium]

Department of Computer Science Presents

Haozhi Qi
PhD Candidate
UC Berkeley

Wednesday, April 16th
3:00pm - 4:00pm
In Person: John Crerar Library Rm 298

Zoom is currently experiencing a massive outage and will be unavailable.

Title: Multisensory Dexterity for Robotics

Abstract: Human hands are essential for sensing and interacting with the physical world, allowing us to grasp and manipulate objects with ease. Replicating this dexterity in robots is the key to unlocking general-purpose robotics in unstructured environments. While modern AI has achieved breakthroughs in many domains, robot dexterity remains an unsolved challenge due to the complexity of high-dimensional control, limited real-world data, and the need for rich multisensory feedback. In this talk, I will present my work on multisensory dexterity for robotics and demonstrate how robots can achieve a broad range of dexterous manipulation capabilities. First, I will introduce how robots develop dexterous manipulation using simple sensory inputs and identify the key ingredients that enable generalizable manipulation across diverse objects, with examples in in-hand and bimanual manipulation. Building on these ingredients, I will then show how integrating rich multisensory feedback—including proprioception, vision, and tactile sensing—improves both perception and control, allowing robots to perform tasks that would be impossible with simple sensors. Finally, I will conclude with future opportunities and open challenges in scaling robotic dexterity and developing robots capable of general-purpose physical interaction.

Bio: Haozhi Qi is a final-year Ph.D. candidate in the EECS Department at UC Berkeley, advised by Prof. Yi Ma and Prof. Jitendra Malik. His research lies at the intersection of robot learning, computer vision, and tactile sensing, with the goal of developing physically intelligent, particularly dexterous, robots for unstructured environments. He received his B.S. in Mathematics and Computer Science from the Hong Kong University of Science and Technology. His work on in-hand perception was featured as the cover article in Science Robotics. He has been recognized with the Outstanding Demo Award at the NeurIPS Robot Learning Workshop and the EECS Evergreen Award for Undergraduate Researcher Mentoring. More information is available at: https://haozhi.io/<https://urldefense.com/v3/__https://www.google.com/url?q=https:**Aurldefense.com*v3*__https:**Ahaozhi.io*__;!!BpyFHLRN4TMTrA!7JFRg0O2XCztLmVrt3rkc6lmNKBGHv8ZkaDVpah5CpC8gw6ervFuOzBkPX_FslBtEEjQRSYfE9XJIqreGQ$&sa=D&source=calendar&ust=1744558039487040&usg=AOvVaw2QDWiRg5bhLIZQ_FcW3prA__;Ly8vLy8vLw!!BpyFHLRN4TMTrA!_5PpXXCvJosquZLuO1PzYHKSKSQ51DXYplLX2wP_DBrn_18zMr4WbzrmXCb21CHmb56EhgzzQzTy2CzEXGAuJKwaEERme-oACtg$>

[photo_haozhi.jpeg]

Host: Pedro Lopes

---
Holly Santos
Executive Assistant to Hank Hoffmann, Liew Family Chair
Department of Computer Science
The University of Chicago
5730 S Ellis Ave-217   Chicago, IL 60637
P: 773-834-8977
hsantos at uchicago.edu







Holly Santos
Executive Assistant to Hank Hoffmann, Liew Family Chairman
Department of Computer Science
The University of Chicago
5730 S. Ellis Ave, Chicago, IL 60637
P: 773.834.8977
hsantos at uchicago.edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20250416/cd549648/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image.jpeg
Type: image/jpeg
Size: 51645 bytes
Desc: Image.jpeg
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20250416/cd549648/attachment-0001.jpeg>