ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “knowledge of deep learning and parallel computing”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.DCcs.AIEmpiricalRecentJun 9, 2026

Piper: A Programmable Distributed Training System

Megan Frisella, Shubham Tiwari, Andy Ruan, Yi Pan +4 more

Piper is a user-controllable distributed training system that decouples the strategy from the runtime implementation, allowing users to declare a comprehensive distributed training strategy with a sma…

View →
cs.DCcs.LGEmpiricalRecentJun 29, 2026

GPU Parallelization Strategies for Forward and Backward Propagation in Shallow Neural Networks: A CUDA-Based Comparative Study

Rania Zitouni, Nadine Bousdjira, Sarah Hasnaoui, Amel Sadoun +1 more

This paper compares and optimizes CUDA strategies for a shallow neural network, achieving a 1.41x speedup on a large dataset.

View →
cs.LGmath.STstat.MLTheoreticalRecentJul 26, 2026

A Statistical Difference between Single-Layer Learning and Hierarchical Learning in Wide Neural Networks

Sumio Watanabe

This paper compares two theoretical frameworks for hierarchical neural networks with a finite but large number of hidden units and shows that training input-to-hidden weights reduces generalization er…

View →
cs.LGcs.AIcs.DSEmpiricalRecentJun 19, 2026

Breaking chains with trees: Deep learning with $\mathcal{O}(\log N)$ parallel time complexity

Neeraj Mohan Sushma, Aditya Nagarsekar, Cabrel Teguemne Fokam, Robin Schiewer +3 more

This paper proposes Hierarchical Block-Local Learning (HBLL), a framework for training deep neural networks without full end-to-end backpropagation, achieving $\mathcal{O}(\log N)$ parallel time compl…

View →
stat.MLcs.LGhep-phEmpiricalRecentJun 18, 2026

Statistical Properties of Training & Generalization

Itay Lavie, Noam Levi, Yonatan Kahn

This paper investigates deep learning from a physics-informed perspective, examining its key features and surprises.

View →
cs.CCTheoreticalRecentJun 16, 2026

Depth Lower Bounds for ReLU Networks with Binary Inputs

Neil Krishnan, Elchanan Mossel

This paper establishes all-depths depth separation for ReLU networks on {0,1}^n.

View →
cs.DCcs.AIEmpiricalRecentJul 2, 2026

Mixture-of-Parallelisms: Towards Memory-Efficient Training Stack for Mixture-of-Experts Models

Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao, Semih Yavuz +2 more

This paper presents a memory-efficient training stack for Mixture-of-Experts (MoE) models, combining and specializing parallelism techniques for maximal efficiency.

View →
q-bio.NCcs.NEEmpiricalRecentJun 22, 2026

Identifying structural design principles shaping the computational abilities of recurrent neural networks

Tom Talpir, Elad Schneidman

This paper explores the relationship between neural network architecture and computational ability, identifying local cycles as a key design principle.

View →
stat.MLcs.LGTheoreticalRecentJul 7, 2026

A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel

Arkaprabha Ganguli, Emil Constantinescu

This paper characterizes the gap between neural network performance and their neural tangent kernel limit on compositional tasks, attributing it to a mismatch between kernel smoothness bias and target…

View →
cs.NIEmpiricalRecentOct 20, 2026

From Partitioning to Provisioning: Co-Designing DNN Deployment and Infrastructure Capacity

Zongyao Huang, Fan Yang, Qi Cao, Yulin Shao

One clear sentence describing what this paper does

View →
cs.DCcs.AIcs.LGEmpiricalRecentJun 26, 2026

Optimizing Teacher-Student Partitioning for Scalable Knowledge Distillation on HPC Systems

Adrian P. Dieguez, Victor Conchello Vendrell, Alex Batlle, Vinnam Kim +2 more

This paper proposes an HPC-aware methodology for Knowledge Distillation (KD) that decouples teacher and student partitioning efficiently, achieving up to 67% higher samples-per-second than the widely…

View →
cs.CCcs.LGcs.LORecentMay 28, 2026

The Complexity of Verifying Feedforward Neural Networks in Quantised Settings

Eric Alsmann, Martin Lange, Marco Sälzer

This paper analyzes the computational complexity of verifying feedforward neural networks when their weights are restricted to finite-width arithmetic, finding that verification remains NP-complete fo…

View →
cs.LGcs.AIcs.DCEmpiricalRecentOct 2, 2026

D2K-Bench: Can LLM Agents Turn Expert Designs into Efficient GPU Kernels?

Daifeng Li, Huiqiang Jiang, Chengruidong Zhang, Wei Wu +5 more

The paper introduces D2K-Bench, a diagnostic benchmark to measure how effectively large language model agents translate expert design guidance into efficient GPU kernels.

View →
cs.DCEmpiricalRecentJul 9, 2026

On the Limitations of Non-GPU AI Accelerators for Large-Model Inference: A Field Study of MoE and Multimodal Serving on Huawei Ascend

Zheng Yu

The paper presents a field study on deploying large inference workloads on a non-GPU AI accelerator and identifies eight categories of limitations.

View →
cs.CRcs.LGApr 18, 2026

Towards Deep Encrypted Training: Low-Latency, Memory-Efficient, and High-Throughput Inference for Privacy-Preserving Neural Networks

Nges Brian Njungle, Eric Jahns, Michel A. Kinsy

This paper develops optimized algorithms and a pipeline architecture for high-throughput, memory-efficient batch processing of encrypted neural network inference, significantly improving performance o…

View →
cs.NEEmpiricalRecentJun 28, 2026

Supervised Hebbian learning in Deep Counterstream Associative Networks

Andreas Knoblauch

A new error backpropagation method called supervised counterstream learning is proposed for deep associative networks, which only requires recognition of errors during training and backpropagates corr…

View →