Teng Su
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces Mpipe, a method for multimodal-aware heterogeneous parallel scheduling in large-scale multimodal language model training, achieving significant speedups on Ascend 910C NPU clusters.
The paper presents HyperParallel-FSDP, a parallelization framework that improves scalability and efficiency for large-scale deep learning models.
Papers
HyperParallel-FSDP: Topology-Aware Fully Sharded Training with Layout-Driven Muon on Ascend SuperPods
Mo Sun, Yifan Yao, Yanwei Liu, Luobin Liu +13 more
The paper presents HyperParallel-FSDP, a parallelization framework that improves scalability and efficiency for large-scale deep learning models.