[Colloquium] Ellis/MS Presentation/May 29, 2015

[Margaret Jaffey]

This is an announcement of Joe Ellis' MS Presentation.

-------------------------------------------------------
Department of Computer Science
The University of Chicago

Date:  Friday, May 29, 2015

Time:  3:00 pm

Place:  Ryerson 276

Bx/MS Candidate:  Joseph Ellis

MS Paper Title:  Effects of a Degraded Network on Hadoop with Erasure Encoded Storage

Abstract:
Erasure encoding storage is becoming a popular technique to reduce storage overhead while maintaining reliability in distributed storage systems, but as the size of these systems grow, network degradation becomes a common occurrence that must be handled appropriately. The current methods of handling degraded networks in large clusters must be redesigned as they make assumptions about how data is stored that are no longer true when using erasure encoded storage. Previous work has studied both the effects of degraded networks on Hadoop along with how to better recover from node failures when using erasure encoded storage, but there has been no study on how to handle degraded networks when using erasure encoded storage. This paper shows that Hadoop’s current methods of handling degraded networks are harmful when using erasure encoded storage and that recomputing blocks that must be read over a slow link is a better mechanism to handle such faults. In comparing these methods of handling a degraded network I hope to show that Hadoop and other similar systems using erasure encoded storage can become more resilient to network faults, thus making the use of erasure codes a more viable option in distributed data storage.

Joe's MS advisor:  Prof. Haryadi Gunawi

A draft copy of Joe's MS paper will be available later.

-------------------------------------------------------

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Margaret Jaffey
margaret at cs.uchicago.edu
Department of Computer Science
Student Affairs Administrator
Ryerson 156
773-702-6011
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=