Skip to main content
Founding Director

Dr. Xian-He Sun

University Distinguished Professor & Ron Hochsprung Endowed Chair
Dr. Xian-He Sun

Dr. Xian-He Sun is the Founding Director of the Gnosis Research Center, an IEEE Fellow (2012), and a University Distinguished Professor (2014) and the Ron Hochsprung Endowed Chair (2021) of Computer Science at Illinois Institute of Technology. Named to the ICPP Wall of Fame as one of the Top 50 contributors in the conference's first 50 years (2023) and recognized in the BenchCouncil Top 100 Chips Achievements (2023), his contributions include the memory-bounded performance model (Sun-Ni Law, 1990), the Concurrent Average Memory Access Time (C-AMAT) framework, published in IEEE Computer in 2014, and the Dataflow under the von Neumann Machine (dataflowV) architecture. The memory-bounded model appears in textbooks as the Sun-Ni Law. Dr. Sun currently serves as Editor-in-Chief of IEEE Transactions on Parallel and Distributed Systems. His archived SCS biography records a B.S. in Mathematics from Beijing Normal University, followed by an M.S. in Mathematics, an M.S. in Computer Science, and a Ph.D. in Computer Science from Michigan State University; it does not give degree years. Before Illinois Tech, he held a postdoctoral appointment at Ames National Laboratory, worked as a staff scientist at ICASE at NASA Langley Research Center, was an ASEE fellow at the U.S. Navy Research Laboratories, and served as an associate professor and founding director of the SCS Laboratory at Louisiana State University in Baton Rouge. He joined Illinois Tech in August 1999. The same biography records his guest-faculty appointment in Argonne National Laboratory's Mathematics and Computer Science Division from 1999 to 2020 and his service as chair of Illinois Tech's Department of Computer Science from fall 2009 to summer 2014.

369Publications
7Patents
18Projects
24Awards
16Grants
12Keynotes
18PhD Graduates

Research Vision

Computing has entered a data-centric era where the bottleneck is no longer computing but data processing. Dr. Sun's research program addresses this fundamental shift across the full stack, from memory system fundamentals (the Sun-Ni Law and C-AMAT model) through software system development (Hermes, LABIOS, ChronoLog) to emerging paradigms (Dataflow under von Neumann). His work establishes the mathematical foundations for memory-bounded data-centric thinking while simultaneously building the systems that translate theory into practice at extreme scale.

Top Collaborators

Anthony Kougkas95 shared pubs
Yong Chen42 shared pubs
Shuibing He34 shared pubs
Hariharan Devarajan32 shared pubs
Jaime Cernuda25 shared pubs
Yanlong Yin24 shared pubs
Rajeev Thakur24 shared pubs
Luke Logan22 shared pubs

Featured Publications

1990

Another View on Parallel Speedup

X.-H. Sun, L. Ni
Proceedings of the 1990 ACM/IEEE Conference on Supercomputing (SC'90)

Presented at SC'90, this paper introduced the concept of memory-bounded speedup for parallel systems. Co-authored with Lionel Ni, it laid the groundwork for the Sun-Ni Law and challenged prevailing assumptions about parallel performance scaling.

1991

Toward A Better Parallel Performance Metric

X.-H. Sun, J. Gustafson
Parallel Computing, Vol. 17, pp.1093-1109

Co-authored with John Gustafson, this work proposed improved parallel performance metrics that account for problem scaling. It has been cited in HPC benchmarking work since.

1992

Efficient Tridiagonal Solvers on Multicomputers

X.-H. Sun, H. Zhang, L. Ni
IEEE Trans. on Computers, Vol. 41, No. 3, pp.286-296

Developed efficient parallel algorithms for tridiagonal systems on multicomputers. Published in IEEE Transactions on Computers, this work demonstrated scalable numerical methods for distributed-memory machines.

1993

Scalable Problems and Memory-Bounded Speedup

X.-H. Sun, L. Ni
Journal of Parallel and Distributed Computing, Vol. 19, pp.27-37

Introduced the memory-bounded speedup model, known as the Sun-Ni Law. It unifies Amdahl's law and Gustafson's scaled speedup as special cases, establishing one of the foundational results in parallel computing theory.

1994

Scalability of Parallel Algorithm-Machine Combinations

X.-H. Sun, D. Rover
IEEE Trans. on Parallel and Distributed Systems

Formally defined scalability for algorithm-machine combinations and proposed a quantitative measurement method. Published in IEEE TPDS, this work set the theoretical foundation for evaluating parallel system scalability.

2002

Performance Modeling and Prediction of Non-Dedicated Network Computing

L. Gong, X.-H. Sun, E. Waston
IEEE Trans. on Computers, Vol 51, No 9, pp. 1041-1055

Developed a mathematical model for predicting performance in non-dedicated network computing environments. Published in IEEE Transactions on Computers, it addressed scheduling and resource sharing on privately owned workstation networks.

2002

A QoS Guided Scheduling Algorithm for the Computational Grid

X. He, X.-H. Sun, G. Laszewski
The International Workshop on Grid and Cooperative Computing (GCC02), Hainan, Chian

Introduced a QoS-guided min-min heuristic for grid task scheduling. It is a reference in distributed resource management and grid computing.

2003

Grid Harvest Service: A System for Long-Term, Application-Level Task Scheduling

X.-H. Sun, M. Wu
The 2003 IEEE International Parallel and Distributed Processing Symposium (IPDPS 2003), Nice, France

Presented Grid Harvest Service (GHS), a long-term task scheduling system for grid computing. It combined performance measurement, prediction, and scheduling into a unified framework for large-scale distributed applications.

2007

lognP and log3P: Accurate analytical models of point-to-point communication in distributed systems

K. Cameron, G. Ge, X.-H. Sun
IEEE Trans. on Computer, vol. 56, no. 3, pp. 314-327

Introduced LognP and Log3P, analytical models of point-to-point communication that account for memory and middleware effects. Published in IEEE Transactions on Computers, these models improved communication cost prediction for clusters of SMPs.

2008

Parallel I/O Prefetching Using MPI File Caching and I/O Signatures

S. Byna, Y. Chen, X.-H. Sun, R. Thakur, W. D. Gropp
The ACM/IEEE SuperComputing Conference (SC'08)

Introduced I/O signature detection and MPI file caching for parallel prefetching. SC'08 Best Paper Finalist that launched the research trajectory toward GRC's I/O systems program.

2010

Reevaluating Amdahl's Law in the Multicore Era

X.-H. Sun, Y. Chen
Journal of Parallel and Distributed Computing, vol. 70, no. 2, pp. 183-188

Revisited Amdahl's Law for multicore processors, showing that memory bandwidth and data access patterns fundamentally alter scaling behavior. Published in JPDC.

2011

Memory Server

Xian-He Sun
US Patent 7,865,570

US Patent 7,865,570. A memory server architecture that provides data access as a service through aggressive prediction of client memory requirements. This patent embodies the data-centric philosophy of offloading data management from client processors.

2014

Concurrent Average Memory Access Time

X.-H. Sun, D. Wang
IEEE Computer, vol. 47, no. 5, pp. 74-80

Defined Concurrent Average Memory Access Time (C-AMAT), extending the classical AMAT metric to account for data access concurrency at both component and system levels. Published in IEEE Computer.

2018

Hermes: A Heterogeneous-Aware Multi-Tiered Distributed I/O Buffering System

A. Kougkas, H. Devarajan, X.-H. Sun
The 27th ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC), Tempe, AZ, USA, 2018. pp. 219-230

Hermes provides multi-tiered I/O buffering across heterogeneous storage hierarchies. Co-authored with Anthony Kougkas, it is the predecessor of IOWarp.

2019Karsten Schwan Best Paper Award

LABIOS: A Distributed Label-Based I/O System

A. Kougkas, H. Devarajan, J. Lofstead, X.-H. Sun
The 28th International Symposium on High-Performance Parallel and Distributed Computing (HPDC'19), Phoenix, USA 2019. pp. 13-24. Karsten Schwan Best Paper Award

Presented LABIOS, a label-based I/O system achieving up to 17x speedup via asynchronous I/O and storage bridging. Co-authored with Anthony Kougkas. Karsten Schwan Best Paper Award at HPDC 2019.

2021Best Paper Award (First Prize)

DLIO: A Data-Centric Benchmark for Scientific Deep Learning Applications

H. Devarajan, H. Zheng, A. Kougkas, X.-H. Sun, V. Vishwanath
The 2021 IEEE/ACM International Symposium in Cluster, Cloud, and Internet Computing (CCGrid'21), May 17 - 20, 2021 Best paper award

DLIO is a data-centric benchmark for deep learning I/O workloads. Co-authored with the GRC team; the MLPerf Storage benchmark (MLCommons) is built on it. Best Paper at CCGrid 2021.

Browse all 369 publications →

Research Interests

Parallel and Distributed Processing
Memory and I/O Systems
Data-Centric Computing
Performance Evaluation

Selected Recent Projects

ChronoLog
· 2020–present
A distributed shared log that orders activity and provenance data with physical time and moves records across memory, lo...
Coeus
· 2021–2026
An active-storage framework that computes derived quantities in transit and queries enriched metadata. The Hades paper r...
DeepIO
· 2021–present
Data-path methods for scientific AI, from the DLIO benchmark and Viper model transfer framework to UnboxKV characterizat...
DiRecMR
DiRecMR studies differences between map and reduce phases to improve task speculation, resource management, and resilien...
DTIO
· 2023–2026
A task-based I/O runtime developed with Argonne National Laboratory to connect HPC, Big Data, and ML data stacks. The SS...
Hermes
· 2018–present
Distributed I/O buffering middleware that coordinates data placement across DRAM, NVMe, burst buffers, and parallel file...
IDES
IDES integrates campus microgrid data with high-performance computing, storage, and networking for energy-system analyti...
IOWarp
· 2024–present
Context-management infrastructure for organizing scientific data, metadata, telemetry, and computational state. CLIO Cor...
IRIS
· 2017–present
Unified data access middleware that translates between parallel file-system and object-store semantics.
LABIOS
· 2018–present
LABIOS represents I/O as labels that carry an operation, data pointer, and routing metadata. Its public prototype routes...
Memory Access Pattern Obfuscation
This project combines cryptographic algorithms, application requirements, and memory architecture designs to protect mem...
OptMem
OptMem modeled data locality and memory-access concurrency together, then applied the model to adaptive prefetching and ...
Portus
Project Lead · 2026–present
A DOE Genesis Mission project led by Pacific Northwest National Laboratory that ports scientific workflows to HPC system...
SMC2 Planning
SMC2 planning combines near-memory processors and a shared remote memory pool in a system design for graph-mining applic...
SPOTTER-AI
Project Lead · 2026–present
A DOE Genesis Mission project led by Argonne National Laboratory that captures provenance across scientific workflows an...
StoreHub
· 2024–2026
StoreHub combined two community instruments, a national workshop, and a landscape analysis to assess the need for dedica...
UniMCC
UniMCC coordinates architecture, code generation, runtime support, and performance models for near-memory processing and...
WisIO
· 2022–2025
WisIO analyzes HPC I/O traces through time, process, and file views, then connects metric-level bottlenecks with root ca...

PhD Students Supervised at IIT

NameYearDissertationCurrent Position
Dr. Jaime Cernuda Garcia2026FlowForge: Taming the Log-Data Storm in Distributed ComputingAssistant Research Professor, Illinois Institute of Technology
Dr. Luke Logan2025RECOMBINANT: A Composable, Extensible, Intelligent I/O Platform for Integrated High-Performance I/O ManagementAssistant Research Professor, Illinois Institute of Technology
Dr. Xiaoyang Lu2024Utilizing Concurrent Data Accesses for Data-driven and AI ApplicationsAssistant Research Professor, Illinois Institute of Technology
Dr. Hariharan Devarajan2021Towards a Self-programmable Storage Solution in Extreme-scale EnvironmentsComputer Scientist, Lawrence Livermore National Laboratory
Dr. Kun Feng2020A Multi-Level Data Integration Approach for the Convergence of HPC and Big Data SystemsSenior HPC Engineer, Illinois Institute of Technology
Dr. Anthony Kougkas2019Accelerating I/O Using Data Labels: A Contention-Aware, Multi-Tiered, Scalable, and Distributed I/O PlatformAssociate Research Professor, Illinois Institute of Technology
Dr. Xu Yang2017Cooperative Batch Scheduling for HPC Systems
Dr. Xi Yang2016An Integrated Data Access System for Big Computing
Dr. Yanlong Yin2014Application-Aware Optimizations for Big Data Access
Dr. Hui Jin2012System Support for Resilience in Large-Scale Parallel Systems: From Checkpointing to MapReduceTechnical Staff, Oracle Research
Dr. Yong Chen2009A Hybrid Data Prefetching Architecture for Data-Access EfficiencyProfessor, Texas Tech University
Dr. Cong Du2008Dynamic Virtual Private Environment in a Shared CyberspacePrincipal Software Engineer, EMC, BRS Division
Dr. Ming Wu2006System Support of Quality of Service in Shared Network EnvironmentsSenior Software Engineer, Fermi National Accelerator Laboratory
Dr. Surendra Byna2006Server-based Data Push Architecture for Data Access Performance OptimizationProfessor of Computer Science, Ohio State University
Dr. Vijay K. Gurbani2004Service-Oriented Computing: Enabling Cross-Network Services between the Internet and the Telecommunications NetworkDistinguished Member of Technical Staff, Lucent Technologies / Bell Labs Innovations
Dr. Kasidit Chanchio2000Efficient Checkpointing in Heterogeneous Collaborative Environments: Representation, coordination, and Automation
Dr. Kirk Cameron2000Empirical and Statistical Application Modeling Using On-Chip Performance Monitors
Dr. Yu Zhuang2000Stable, Globally Non-iterative, Non-overlapping Domain Decomposition Methods for the Numerical Solution of Parabolic Evolutionary Systems

Awards & Honors

2020s
2023ICPP Wall of Fame: Top 50 in the First 50 Years, International Conference on Parallel ProcessingCareer
2022CSE Distinguished Alumni Award, College of Engineering, Michigan State UniversityCareer
2021Best Paper Award (First Prize), CCGrid'21, IEEE/ACM CCGridBest Paper
2020Ron Hochsprung Endowed Chair of Computer Science, Illinois Institute of TechnologyAppointment
2010s
2019Karsten Schwan Best Paper Award, HPDC'19, ACM HPDCBest Paper
2016IEEE Computer Society 2016 Golden Core Award, IEEE Computer SocietyCareer
2016Best Paper Award, ISPA'16, IEEE ISPABest Paper
2016IEEE Computer Society Meritorious Service Certificate, IEEE Computer SocietyService
2015Best Paper Award, ACM SIGSIM PADS'15, ACM SIGSIM PADSBest Paper
2015Best PhD Colloquium Award, ACM SIGSIM PADS'15, ACM SIGSIM PADSMentoring
2014ACM Service Award, ACM SIG Governing BoardService
2014University Distinguished Professor, Illinois Institute of TechnologyAppointment
2011IEEE Fellow (class of 2011), IEEECareer
2011Best Paper Award, ISPA'11, IEEE ISPABest Paper
2000s
2009ACM Senior Member, ACMCareer
2009Sigma Xi Senior Faculty Award, Illinois Institute of Technology & Sigma Xi Honor SocietyInstitutional
2008Best Paper Finalist, SC'08, ACM/IEEE SuperComputing ConferenceBest Paper
2006Tan Chin Tuan Fellow, Nanyang Technological University, SingaporeCareer
2006Dean's Excellence Award for Research, College of Science and Letters, Illinois Institute of TechnologyInstitutional
2006V-Tech High-End Computing Challenge Honorable Mention (with Cong Du, for MPI-Mitten), Virginia Tech, NSF, and DOEResearch
2003Best Student Poster Award, SC'03 (with Surendra Byna, William Gropp, Rajeev Thakur), ACM/IEEE SuperComputing ConferenceBest Paper
2001IEEE Computer Society Distinguished Visitor, IEEE Computer SocietyService
2001Best Paper Award, ICPP'01, International Conference on Parallel ProcessingBest Paper

Selected Keynotes

“From Parallel Computing to Concurrent Data Access: The Dataflow under von Neumann Machine Approach”
27th International Conference on High Performance Computing and Communications (HPCC 2025)Exeter, UKAugust 2025
“Dataflow under the von Neumann Machine: A New Paradigm for Computing Systems”
5th Workshop on Performance Engineering, Modeling, Analysis, and Visualization Strategy (PERMAVOST 2025), in conjunction with ACM HPDC 2025July 2025
“The Data-Centric Imperative: from Hermes to StoreHub”
37th International Conference on Scalable Scientific Data Management (SSDBM 2025)Columbus, OhioJune 2025
“Dataflow under the Von Neumann machine: A Destructive New under Existing Systems”
HPC Asia 2025 (invited talk)Hsinchu City, TaiwanFebruary 2025
“Hermes, Coeus, and ChronoLog: Some big data I/O systems for network, parallel and distributed computing”
IFIP International Conference on Network and Parallel Computing (NPC 2024)Haikou, ChinaDecember 2024
“AI & Data: Challenges and Opportunities in Computer System Research”
24th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGrid 2024)Philadelphia, PAMay 2024
“Data Centric Computing: an I/O System Approach”
25th IEEE International Conference on High Performance Computing and Communication (HPCC 2023)Melbourne, AustraliaDecember 2023
“High Performance Data Access: The Hermes Approach”
13th International Photonics and Optoelectronics Meetings (POEM 2021), Workshop on Information Storage System and Technology (ISST)November 2021

Funded Research

Active
Lawrence Livermore National Laboratory
Co-PIMachine Learning Driven Approach to Extract I/O Intents to Improve Efficiency of Deep Learning Training
National Science Foundation
PICollaborative Research: Frameworks: IOWarp: Bending the I/O Fabric for Advancing AI-Infused Scientific Workflows (OAC-2411318)
iowarp
National Science Foundation
PICollaborative Research: CIRC: Planning-C: StoreHub: A Community Infrastructure for Shaping the Future of Data Storage Research (CNS-2346504)
storehub
National Science Foundation
PITowards A Unified Memory-centric Computing System with Cross-layer Support (CNS-2310422)
unimcc
National Science Foundation
PILABIOS: Storage Acceleration via Data Labeling and Asynchronous I/O (OAC-2313154)
labios
Department of Energy
PIDTIO: Enabling Computational Storage using Data-Tasks and Asynchronous I/O (DE-SC0024593)
dtio
Lawrence Livermore National Laboratory
PIIdentifying and Mitigating I/O Bottlenecks for HPC Workflows
Argonne National Laboratory
Co-PIOptimizing metadata for efficient discovery of inference models in Deep Learning workflows
Department of Energy
Local-PICoeus: Accelerating Scientific Insights Using Enriched Metadata (DE-SC0023263)
coeus
National Science Foundation
PIPractical Memory Access Pattern Obfuscation with Algorithm, Application and Architecture Co-designs (CNS-2152497)
National Science Foundation
PIFrameworks: Collaborative Research: ChronoLog: A High-Performance Storage Infrastructure for Activity and Log Workloads (OAC-2104013)
chronolog
Completed
Pacific Northwest National Laboratory
PIOptimizing Data-Intensive Workflows by Understanding Data
National Science Foundation
Co-PICollaborative Research: PPoSS: Planning: Towards an Integrated, Full-stack System for Memory-centric Computing (CCF-2029014)
National Science Foundation
PICollaborative Research: SHF: Small: Optimization of Memory Architectures: A Foundation Approach (CCF-2008907)
optmem
National Science Foundation
PIFramework: Software: NSCI: Collaborative Research: Hermes: Extending the HDF Library to Support Intelligent I/O Buffering for Deep Memory and Storage Hierarchy Systems (OAC-1835764)
hermes
National Science Foundation
PICSR: Small: IRIS: A Unified Data Access Framework for the Merging of Compute-Centric and Data-Centric Storage (CSR-1814872)
iris

News Mentions