20 results for “Knowledge of high-performance computing”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
This paper proposes an HPC-aware methodology for Knowledge Distillation (KD) that decouples teacher and student partitioning efficiently, achieving up to 67% higher samples-per-second than the widely…
This paper assesses HPC education at 102 academic institutions in Germany, identifying 178 HPC-related courses and evaluating their competency coverage and curricular placement, as well as examining l…
Ziyu Huang, Yangjie Zhou, Chenhao Zhu, Zihan Liu +12 more
This paper presents Weave, a system that improves the performance of Mixture-of-Experts (MoE) inference by dynamically scheduling GPU resources.
The paper introduces Rotary GPU, an exploratory execution approach demonstrating that large Mixture-of-Experts models can be run locally on consumer GPUs with limited VRAM, achieving usable decode thr…
The paper introduces EduMPI, a learning support tool for simplifying cluster usage and performance analysis of MPI parallel programs for students.
This paper presents a simulation framework to optimize workflow composition in high-throughput computing environments, demonstrating up to 3.8x throughput increase and a 14.9x reduction in network ove…
This paper compares the performance of four parallelization variants of the tiled Cholesky decomposition using OpenMP and HPX runtimes.
Yunfei Feng, Jingkai He, Shiqi Liu, Cheng Zhang +2 more
The paper presents FastEEP, a system for fast intra-instance scaling of Mixture-of-Experts (MoE) models in production.
Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao, Semih Yavuz +2 more
This paper presents a memory-efficient training stack for Mixture-of-Experts (MoE) models, combining and specializing parallelism techniques for maximal efficiency.
The paper presents ArchAgent, a hierarchical multi-agent framework for optimizing AI/HPC system design.
The authors propose nomp, a framework for building domain-specific compilers to improve programmer productivity without sacrificing performance and portability.
This paper presents a practical MPI malleability methodology for HPC clusters.
The paper proposes a fine-grained approach to overlap expert compute with the second all-to-all communication in Mixture-of-Experts (MoE) models, improving distributed MoE execution efficiency on mult…
Shuoming Zhang, Qiuchu Yu, Yangyu Zhang, Ruiyuan Xu +5 more
KLineage introduces a novel method to teach LLMs when and how to apply GPU kernel optimizations by reverse-engineering expert kernel lineages, resulting in superior optimization skills compared to exi…
HighTide is an evolving, AI-assisted, open-source benchmark suite for VLSI design, providing a comprehensive and scalable platform for hardware development.
Peter Heger, Lech Nieroda, Roland Pabel, Christoph Stollwerk +6 more
RAMSES is a new HPC system that integrates hardware-based memory encryption and state-of-the-art file encryption to deliver high performance and robust security.