Skip to main content

LABIOS: A Distributed Label-Based I/O System

Authors: A. Kougkas, H. Devarajan, J. Lofstead, X.-H. Sun

Date: June, 2019

Venue: The 28th International Symposium on High-Performance Parallel and Distributed Computing (HPDC'19), Phoenix, USA 2019. pp. 13-24. Karsten Schwan Best Paper Award

Type: Conference

Abstract

In the era of data-intensive computing, large-scale applications, in both scientific and the BigData communities, demonstrate unique I/O requirements leading to a proliferation of different storage devices and software stacks, many of which have conflicting re- quirements. In this paper, we investigate how to support a wide variety of conflicting I/O workloads under a single storage system. We introduce the idea of a Label, a new data representation, and, we present LABIOS: a new, distributed, Label- based I/O system. LABIOS boosts I/O performance by up to 17x via asynchronous I/O, supports heterogeneous storage resources, offers storage elastic- ity, and promotes in-situ analytics via data provisioning. LABIOS demonstrates the effectiveness of storage bridging to support the convergence of HPC and BigData workloads on a single platform.

Tags

Label-Based I/OStorage BridgingHeterogeneous I/ODatalabelsTask-Based I/OExascale I/OEnergy-Aware I/OElastic StorageHermes