2 articles tagged "LLM inference"

Two papers with GRC authors appeared at the 35th International Symposium on High-Performance Parallel and Distributed Computing (HPDC 2026), held in Cleveland from July 13 to 16. PKAS, which Jie Ye presented on July 14, schedules LLM inference by predicting how much KV cache memory each request will need. Metis, in the REX-IO workshop, uses LLM agents to explain what HPC I/O functions do.

Between March and May 2026, GRC researchers and their collaborators presented four papers on one problem: long-context LLM inference is limited by how data moves through the memory hierarchy, not only by compute. The papers appeared at ASPLOS, EACL, DATE and IPDPS, and their answers range from a hardware prefetcher to KV cache pruning. A fifth paper, also at IPDPS, applies the same I/O lens to HPC workflows.