[Colloquium] 5/6 Shuaiwen Leon Song (Together AI) - DeepSpeed4Science: Enabling System Support for Large Signature AI4Science Models at Scale

[Holly Santos]

Department of Computer Science Colloquium

Shuaiwen Leon Song
Vice President of Research and Frontier Technologies
Together AI

Monday, May 6th
2:30pm - 3:30pm 
In Person: John Crerar Library 390

Title: DeepSpeed4Science: Enabling System Support for Large Signature AI4Science Models at Scale

Abstract:  With the new era of AIGC and large-scale language models being applied to change the landscape of the scientific discovery, I led the DeepSpeed at Microsoft to establish a new initiative with our partners from industry, academia and federal research labs to enable new science-driven system technologies to support large-scale science discovery (https://www.microsoft.com/en-us/research/blog/announcing-the-deepspeed4science-initiative-enabling-large-scale-scientific-discovery-through-sophisticated-ai-system-technologies/ <https://urldefense.com/v3/__https://www.microsoft.com/en-us/research/blog/announcing-the-deepspeed4science-initiative-enabling-large-scale-scientific-discovery-through-sophisticated-ai-system-technologies/__;!!BpyFHLRN4TMTrA!963-g-zd2RasUqMKf6YMpa-YvdL4iY0egOVfqsY433C6I40pTvKsdx08WQHs_-CRgYR0SpRTsI5q8wh8T4w$>). In this talk, I will cover several of our signature models and engagements from our first releases of DeepSpeed4Science and discuss what system technologies have been developed and some future endeavors. Finally, I will show my vision on how to build a ML system research capability and community (e.g., a large collaborative initative) for scientific discovery at University of Chicago, serving as a public forum for scientists around the world to quickly acquire the essential system technologies that bottleneck their model development/deployment and contribute to this roadmap. 

Bio:  Shuaiwen Leon Song is the vice president of research and frontier technologies at Together AI, a unicorn AI startup in San Francisco focusing on building the fastest and most cost-efficient large-scale cloud services for the generative AI era. Prior to this role, he was a senior principal scientist and manager at Microsoft. He was also the chief scientist for Deepspeed4Science initiative which created a broad engagement between Microsoft, Microsoft research, DoE labs, academia and industry partners to enable sophisticated system technology research and development for supporting various aspects of training and inference for large-scale AI-driven scientific models. At Microsoft, he also managed the Brainwave for Bing, a legacy AI infrastructure project for cloud inference. Prior to Microsoft, he was the SOAR associate professor at University of Sydney and an adjunct professor at University of Washington.  His past works in HPC have received several best paper nominations and were featured in U.S. DoE research highlights and other media outlets. He was the recipient of several awards including IEEE early-career award for HPC, IEEE mid-career award for scalable computing, Facebook faculty award, Google brain faculty award, Australian most innovative engineer award, and AIR global faculty award. 




Hosts: Hank Hoffmann, Mike Franklin, Dan Nicolae

---
Holly Santos
Executive Assistant to Hank Hoffmann, Liew Family Chair
Department of Computer Science
The University of Chicago
5730 S Ellis Ave-217   Chicago, IL 60637
P: 773-834-8977
hsantos at uchicago.edu






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20240429/333121c0/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image.jpeg
Type: image/jpeg
Size: 20669 bytes
Desc: not available
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20240429/333121c0/attachment-0001.jpeg>