[Colloquium] 3/6 Akari Asai (Washington) Beyond Scaling: Frontiers of Retrieval-Augmented Language Models

[Holly Santos via Colloquium]

Department of Computer Science and Data Science Institute Presents

Akari Asai
PhD Candidate
University of Washington

Thursday, March 6th
2:00pm - 3:00pm
In-Person: John Crerar Library Rm 390

Title: Beyond Scaling: Frontiers of Retrieval-Augmented Language Models

Abstract: Large Language Models (LMs) have demonstrated remarkable capabilities by scaling up training data and model sizes. However, they continue to face critical challenges, including hallucinations and outdated knowledge, which particularly limit their reliability in expert domains such as scientific research and software development. In this talk, I will urge the necessity of moving beyond the traditional scaling of monolithic LMs and advocate for Augmented LMs—a new AI paradigm that designs, trains, and deploys LMs alongside complementary modules to address these limitations. Focusing on my research on Retrieval-Augmented LMs, one of the most impactful and widely adopted forms of Augmented LMs today, I will begin by presenting our systematic analyses of current LM shortcomings and demonstrate how Retrieval-Augmented LMs offer a more effective and efficient path forward. I will then discuss my work to establish new foundations for further reliability and efficiency by designing and training new LMs and retrieval systems to dynamically adapt to diverse inputs. Finally, I will demonstrate the real-world impact of such Retrieval-Augmented LMs through OpenScholar, our fully open Retrieval-Augmented LM designed to assist scientists in synthesizing scientific literature, now used by more than 30,000 researchers and practitioners worldwide. I will conclude by outlining my vision for the future of Augmented LMs, emphasizing advancements in their abilities to handle heterogeneous and diverse modalities, more efficient and effective integration with diverse components, and advancing evaluations with interdisciplinary collaboration.

Bio: Akari Asai is a Ph.D. candidate in the Paul G. Allen School of Computer Science & Engineering at the University of Washington. Her research addresses the limitations of large language models (LMs) by developing advanced systems, such as Retrieval-Augmented LMs, and applying them to real-world challenges, including scientific research and underrepresented languages. Her contributions have received widespread recognition, including multiple paper awards at top NLP and ML conferences, the EECS Rising Stars 2022, and MIT Technology Review's Innovators Under 35 Japan. She has also been honored with the IBM Global Fellowship and several industry grants. Akari actively engages with the research community as a co-organizer of high-impact tutorials and workshops, including the first tutorial on Retrieval-Augmented LMs at ACL 2023, as well as NAACL 2022 workshop on Multilingual Information Access and NAACL 2025 Workshop on Knowledge-Augmented NLP.

[https://lh7-rt.googleusercontent.com/docsz/AD_4nXfYP7-bzz53oxmv_QA-ci1lVykR5E5n9zpA0JDdDRSom_IsCs_MSfZ-erVBuPDB3epeLs0v75NBxzUPHPbUvlr1zlGnOv-yTZLXM614EtbrsFqq8INCr_WRs72c9kE13yb3MhUqFA?key=to6ZnQdqjNM6ZH3B_FZmex6h]

Host: Mike Franklin

---
Holly Santos
Executive Assistant to Hank Hoffmann, Chairman
Department of Computer Science
The University of Chicago
5730 S Ellis Ave-217   Chicago, IL 60637
P: 773-834-8977
hsantos at uchicago.edu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cs.uchicago.edu/pipermail/colloquium/attachments/20250206/50325754/attachment.html>