Skip to main content

6 articles tagged "Memory systems"

View All Tags

Spring 2026 papers: LLM inference meets the memory hierarchy

AI & Data · · 5 min read

Between March and May 2026, GRC researchers and their collaborators presented four papers on one problem: long-context LLM inference is limited by how data moves through the memory hierarchy, not only by compute. The papers appeared at ASPLOS, EACL, DATE and IPDPS, and their answers range from a hardware prefetcher to KV cache pruning. A fifth paper, also at IPDPS, applies the same I/O lens to HPC workflows.

HPCC 2025 keynote: from parallel computing to concurrent data access

Talks & Insights · · 3 min read

Xian-He Sun gave a keynote at the 27th IEEE International Conference on High Performance Computing and Communications (HPCC 2025) in Exeter, UK, which ran from August 13 to 15, 2025. In "From Parallel Computing to Concurrent Data Access: The Dataflow under von Neumann Machine Approach", he argued that decades of work on faster computation have made the data access problem worse.

PERMAVOST 2025 keynote: dataflow under the von Neumann machine

Talks & Insights · · 2 min read

Xian-He Sun gave the keynote at the 5th Workshop on Performance Engineering, Modeling, Analysis, and Visualization Strategy (PERMAVOST 2025), held with ACM HPDC 2025 at the University of Notre Dame on July 20, 2025. His talk, "Dataflow under the von Neumann Machine: A New Paradigm for Computing Systems", spoke directly to the workshop's focus on performance modeling.

HPC Asia 2025 invited talk: dataflow under the von Neumann machine

Talks & Insights · · 3 min read

Xian-He Sun gave the third invited talk at HPC Asia 2025 in Hsinchu, Taiwan, on February 20, 2025. The program lists it as "Dataflow under the Von Neumann machine: A Destructive New under Existing Systems". Sun argued that the memory wall, not raw compute, now limits AI systems, and presented a data-centric approach to it.

MegaMmap at SC24: tiered distributed shared memory beyond DRAM

Storage · · 6 min read

Luke Logan presented MegaMmap at SC24, the International Conference for High Performance Computing, Networking, Storage, and Analysis, held in Atlanta from November 17 to 22, 2024. The paper, by Logan, Anthony Kougkas and Xian-He Sun, describes a software distributed shared memory that extends memory into storage, so that applications can work on datasets larger than the DRAM of their nodes without writing out-of-core code.

ACA 2020 keynote: data flow under the von Neumann architecture

Talks & Insights · · 3 min read

Xian-He Sun gave an invited keynote at the 13th CCF National Computer Architecture Conference (CCF ACA 2020) on August 13, 2020. The conference, held every two years, ran online from August 10 to 16. His talk, "Data flow under the von Neumann Computer Architecture", asked how to design a data-centric architecture for the big data era and introduced an approach he named dataflowV.