HPBD&IS 2020 keynote: label-based data representation for big data I/O
Xian-He Sun gave a keynote at the 2020 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS 2020) on May 23, 2020. The talk, "dLABEL: A Label-Based Data Representation and its implementation on Big Data I/O Systems", proposed attaching operations to data through labels and showed the idea working in LABIOS, GRC's label-based I/O system.
Conflicting demands on storage
Large-scale applications in the big data era have data management needs that pull in different directions. Those needs have produced a growing range of hardware devices and software stacks, many with conflicting requirements. Sun argued that, despite years of effort, data movement, storage and management are still the main performance bottlenecks of modern HPC systems.
Data labels
The talk introduced a data representation called the data label, or dLabel. A dLabel attaches an operation to the data it acts on and marks the pair with a label. Because each label carries both the data and what should happen to it, the storage system can decide where and when to carry out the operation, independently of the application that issued it. This separates data management from data operations and makes software-defined data management possible.
LABIOS
To show what dLabel can do, Sun presented LABIOS, a distributed I/O system built on labels. In the talk he reported that LABIOS improves I/O performance by up to 17 times through asynchronous I/O. It also supports heterogeneous storage resources, lets storage grow and shrink with demand, and supports in-situ analytics by provisioning data to analysis tasks. Because labels are independent units of work, one LABIOS deployment can serve I/O workloads that would conflict on a conventional file system, which helps HPC and big data workloads share the same storage.
LABIOS was published at ACM HPDC 2019 by Anthony Kougkas, Hariharan Devarajan, Jay Lofstead and Sun, where it received the Karsten Schwan Best Paper Award. Sun closed by noting that LABIOS shows dLabel works on current memory and file systems, and that the full potential of the representation is still to be explored.
