Hanjiang Wu
3 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper systematically analyzes the benefits and limits of Attention-FFN Disaggregation (AFD) for Mixture-of-Experts (MoE) LLM serving, demonstrating that AFD is crucial for achieving high throughput under strict latency constraints.
The paper systematically analyzes the benefits and limits of Attention-FFN Disaggregation (AFD) for Mixture-of-Experts (MoE) LLM serving, demonstrating that AFD is crucial for achieving high throughput under strict latency constraints.
This paper updates the ASTRA-sim simulator for distributed machine learning with new features and a standardized infrastructure representation.
Papers
ASTRA-sim 3.0: Next-Level Distributed Machine Learning Simulations via High-Fidelity GPU and Infrastructure Modeling
William Won, Jinsun Yoo, Tuan Ta, Moumita Dey +15 more
This paper updates the ASTRA-sim simulator for distributed machine learning with new features and a standardized infrastructure representation.