Jie Ye is a PhD candidate in the Department of Computer Science at the Illinois Institute of Technology and a member of the Gnosis Research Center. She is advised by Xian-He Sun and Anthony Kougkas. Her research focuses on accelerating LLM/DNN inference; KV cache management and offloading of models and KV caches; advanced data-transfer strategies between training applications and inference systems; optimizing LLM/DNN training; and GPUDirect data transfer.
- Joined
- Aug 2020
- Expected graduation
- May 2027
- Advisors
- Anthony Kougkas and Xian-He Sun
13Publications
4Projects
Research interests
- Distributed Storage
- Parallel and Distributed Systems
- LLM/DNN Inference Optimization
- LLM KV Cache management
- LLM/DNN Training Optimization
Projects
Publications
2026
PKAS: Predictive KVCache-Aware Scheduling for Faster LLM and Transformer Inferences
2026
PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference
2025
Insights into GPUDirect Data Transfer through NIXL Benchmarking
2025
Characterizing the Behavior and Impact of KV Caching on Transformer Inferences under Concurrency
2025
Accelerate LLM inference with Asynchronous model offload
2024
Uncover the Overhead and Resource Usage for Handling KV Cache Overflow in LLM Inference
2024
DaYu: Optimizing Distributed Scientific Workflows by Decoding Dataflow Semantics and Dynamics
2024
HStream: A hierarchical data streaming engine for high-throughput scientific applications
2024
Viper: A High-Performance I/O Framework for Transparently Updating, Storing, and Transferring Deep Neural Network Models
2022
