[CS] Haochen Pan MS Presentation/Oct 8,2024

via cs cs at mailman.cs.uchicago.edu
Mon Sep 30 10:34:48 CDT 2024


This is an announcement of Haochen Pan's MS Presentation
===============================================
Candidate: Haochen Pan

Date: Tuesday, October 8,2024

Time: 1:30PM -3:30PM CT 

Location: JCL 390

Title:  Experiences with a Hybrid Event-Driven Architecture for Distributed Scientific Computing

Abstract: Scientific research and discovery increasingly depend on distributed computational resources, advanced storage systems, high-speed networks, and modern scientific instruments, ranging from high-performance computing (HPC) and cloud systems to edge and intermittent computing devices. Event-driven architecture (EDA) benefits applications targeting distributed research infrastructures (DRI) by improving the organization, communication, processing, reliability, and security of events generated from various sources.

To advance the development of scientific EDA, this thesis introduces Octopus, a hybrid, cloud-to-edge event fabric designed to seamlessly link many local event producers and consumers with cloud-hosted event brokers, and to provide a fabric for developing resilient applications. Octopus can be scaled to meet demand, permits the deployment of highly available Triggers for automatic event processing, and enforces fine-grained access control.

This thesis identifies the requirements of use cases in self-driving laboratories, scientific data automation, online task scheduling, epidemic modeling, and dynamic workflow management, and presents results demonstrating Octopus’ ability to meet those requirements. Octopus supports producing and consuming events from distributed clients at a rate of over 4.2 M and 9.6 M events per second, respectively.

Advisors: Ian Foster and Kyle Chard

Committee: Kyle Chard, Ian Foster, André Bauer, and





More information about the cs mailing list