ArXivCSExplorer
β˜†β˜†BookmarksπŸ†RSSHow to UseFAQ
Built with and by Teycir Ben Soltaneβ€’
How to Useβ€’FAQβ€’GitHubβ€’arXiv.orgβ€’
Share:

20 results for β€œGPU parallelism”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.β“˜

Want pure semantic search? Try claim verification β†’

cs.DCEmpiricalRecentJun 15, 2026

Tangram: Hiding GPU Heterogeneity for Efficient LLM Parallelization

Yanda Tao, Pedro F. Silvestre, Marcel WagenlΓ€nder, Peter Pietzuch

Tangram enables the use of existing LLM parallelizers in heterogeneous GPU clusters by decoupling parallelization planning from GPU heterogeneity.

View β†’
cs.DCEmpiricalRecentOct 30, 2026

MemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU Training

Lin Meng, Yuzhong Sun, Jie Zhu

This paper presents MemX, a memory-aware automatic parallelism system for large-scale model training on cross-vendor heterogeneous GPU clusters.

View β†’
cs.DCcs.LGcs.PFEmpiricalRecentJun 11, 2026

GF-DiT: Scheduling Parallelism for Diffusion Transformer Serving

Xinwei Qiang, Yifan Hu, Shixuan Sun, Jing Yang +5 more

GF-DiT: A policy-programmable runtime for elastic DiT serving

View β†’
cs.DCcs.LGEmpiricalRecentJun 29, 2026

GPU Parallelization Strategies for Forward and Backward Propagation in Shallow Neural Networks: A CUDA-Based Comparative Study

Rania Zitouni, Nadine Bousdjira, Sarah Hasnaoui, Amel Sadoun +1 more

This paper compares and optimizes CUDA strategies for a shallow neural network, achieving a 1.41x speedup on a large dataset.

View β†’
cs.AREmpiricalRecentOct 16, 2026

TileDRAM: Compiler-Controlled Tile-to-DRAM Layouts for 3D DRAM GPGPUs

Guangyuan Xu, Lanxuan Zhang, Ziyang Li, Zhaoshi Li +1 more

This paper presents TileDRAM, a compiler-runtime toolchain that introduces tile-to-DRAM layouts as a compiler-visible abstraction for DRAM placement.

View β†’
cs.DCEmpiricalRecentJul 24, 2026

$g$MAGNUS: Fast SpGEMM on GPUs for Irregular Matrices via Hierarchical Multisplit

Jordi Wolfson-Pou, Ahmed Helal, Fabrizio Petrini

The paper introduces $g$MAGNUS, a new algorithm for sparse matrix-matrix multiplication on GPUs that addresses heavy rows by reordering intermediate products and achieves significant speedups.

View β†’
cs.AREmpiricalRecentJul 22, 2026

DGNA: Dissecting GPU NUMA Architecture through Microbenchmarking and Data Analysis

Changxi Liu, Yun Chen, Trevor E. Carlson

This paper introduces DGNA, a methodology to unveil the Non-Uniform Memory Access (NUMA) architecture of GPU memory hierarchy through microbenchmarking and data analysis.

View β†’
eess.SPcs.DCEmpiricalRecentJul 26, 2026

Parallel Cascaded Recursive Filtering on Multi-Core CPUs and GPUs

Haotian Zhai, Bernd-Peter Paris

This paper reformulates cascaded second-order filtering as a block-tridiagonal linear system and develops parallel solution algorithms, achieving high performance on SIMD cores, multi-core CPUs, and G…

View β†’
cs.DCcs.LGEmpiricalRecentJul 25, 2026

Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

Zhihao Xu, Hao Zhong, Zeting Zhou, Yuhang Xu +8 more

This paper proposes Gleam, a framework for efficient GPU sharing across local-area CUDA devices, reducing bandwidth overhead, improving API call latency, and ensuring context consistency.

View β†’
cs.ARcs.DCcs.PFEmpiricalRecentJul 30, 2026

Characterizing LLM Kernel Access and Memory Interaction in Multi-Partition NUMA GPUs

Donghyeon Joo, Sooraj Puthoor, Nuwan Jayasena, Bahar Asgari

This paper analyzes data access patterns in large language model workloads on multi-partition GPUs and presents optimization strategies based on inter-workgroup sharing patterns.

View β†’
cs.LGcs.AIcs.DCEmpiricalRecentOct 2, 2026

D2K-Bench: Can LLM Agents Turn Expert Designs into Efficient GPU Kernels?

Daifeng Li, Huiqiang Jiang, Chengruidong Zhang, Wei Wu +5 more

The paper introduces D2K-Bench, a diagnostic benchmark to measure how effectively large language model agents translate expert design guidance into efficient GPU kernels.

View β†’
cs.DCEmpiricalRecentJul 24, 2026

Agentic CPU-GPU Scheduling for Heterogeneous AI Workloads

Tianxi Lu, Sherief Reda

This paper identifies suboptimalities in default GPU-first scheduling for AI tool workloads and proposes an agentic scheduler that adaptively assigns tools to GPU or CPU based on runtime factors.

View β†’
cs.DCEmpiricalRecentJun 12, 2026

parRSB: Exascale Spectral Element Mesh Partitioning

Thilina Ratnayaka, Paul Fischer

The paper introduces parRSB, a parallel graph partitioner for spectral element meshes that produces high-quality partitions.

View β†’
cs.GRcs.CVcs.DCEmpiricalRecentJul 17, 2026

Rendering 3D Gaussians on a Graph Processor

Nicholas Fry, Ignacio Alzugaray, Mark Pupilli, Paul H. J. Kelly +1 more

First implementation of a 3D Gaussian renderer on an Intelligence Processing Unit (IPU) with 1,472 independent tiles using only on-chip SRAM.

View β†’