ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

~ similar to 2606.19271· 20 results

cs.DCcs.AIcs.LGEmpiricalRecentJun 23, 2026

CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

Zhuoren Ye, Tianyu Wo, Dinghao Xue, Mingming Zhang +3 more

This paper proposes CrossPool, a serving engine for cold Machine Learning Models (LLMs) that separates weights and KV-cache into two GPU memory pools to improve GPU memory utilization and long-context…

View →
cs.DCcs.LGcs.PFEmpiricalRecentJun 11, 2026

GF-DiT: Scheduling Parallelism for Diffusion Transformer Serving

Xinwei Qiang, Yifan Hu, Shixuan Sun, Jing Yang +5 more

GF-DiT: A policy-programmable runtime for elastic DiT serving

View →
cs.DCEmpiricalRecentAug 13, 2026

Balancing Workload Performance and Slurm Stress: Four Nextflow Deployment Strategies

Nil Tianchen Mu, William Dizon, Glen Otero, Torey Battelle

This paper presents a measurement protocol and benchmarking harness for evaluating the performance of different multi-node strategies for submitting tasks on shared Slurm clusters, focusing on their i…

View →
cs.DCEmpiricalRecentJun 29, 2026

Energy-Aware Scheduling for Serverless LLM Serving on Shared GPUs

Tianyu Wang, Gourav Rattihalli, Aditya Dhakal, Longfei Shangguan +1 more

This paper presents Festina, a profiling-guided, power-aware control plane for minimizing energy consumption in serverless large language model (LLM) serving.

View →
cs.OScs.DCcs.LGEmpiricalRecentAug 16, 2026

Global Simulation-Guided Dynamic Operator Scheduling for Efficient Multi-Tenant Model Serving

Weinan Liu, Zeyuan Ding, Dian Ding, Chengcheng Wan +4 more

This paper presents SliceScheduler, a dynamic operator-level scheduling system for multi-tenant model serving that improves GPU utilization and maintains SLA.

View →
cs.DCcs.MATheoreticalRecentJul 3, 2026

A Workflow-Aware Serving Layer for Agentic Applications

Jiayi Qian, Zishen Wan, Hanchen Yang, Chun Tao +2 more

The paper presents Dyserve, a workflow-aware serving layer for agentic AI applications that compiles per-node model and verifier choices into an integer linear program, allowing for efficient model se…

View →
cs.SEcs.AIEmpiricalRecentJun 10, 2026

Characterizing Software Aging in GPU-Based LLM Serving Systems

Domenico Cotroneo, Bojan Cukic

This paper studies software aging in GPU-based LLM serving systems using a 216-hour campaign.

View →
cs.LGcs.DCEmpiricalRecentJun 18, 2026

Execution-State Capsules: Graph-Bound Execution-State Checkpoint and Restore for Low-Latency, Small-Batch, On-Device Physical-AI Serving

Liang Su

This paper introduces execution-state capsules for low-latency, small-batch, on-device AI serving.

View →
cs.CVcs.AIRecentMay 28, 2026

SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer

Yuyang Zhao, Yicheng Pan, Qiyuan He, Jincheng Yu +5 more

SANA-Streaming introduces a novel, efficient framework that enables real-time, high-resolution streaming video-to-video editing by combining a hybrid diffusion transformer with specialized training an…

View →
cs.DCcs.LGcs.PFEmpiricalRecentSep 25, 2026

EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

Kunxiong Zhu, Zhihao Shu, Hangyu Zheng, Minghai Qin +3 more

EAServe optimizes and improves the performance of multimodal LLMs by repositioning Encode as the control point of the EPD pipeline

View →
cs.DCcs.NIEmpiricalRecentOct 1, 2026

Beaver: Elastic GPU Sharing between ML and Latency-Critical vRAN Workloads

Yuncheng Yao, Zhenzhou Qi, Junyao Zheng, Chung-Hsuan Tung +2 more

This paper presents Beaver, a GPU sharing system that jointly manages compute and memory resources to protect the vRAN's strict processing deadline while serving AI workloads.

View →
cs.OSEmpiricalRecentJun 3, 2026

GNStor: Design of GPU-Native High-Performance Remote All-Flash Array

Shushu Yi, Wenbo Wu, Guoci Chen, Junrong Zhu +5 more

GNStor is a GPU-native AFA system that enables direct GPU access to remote AFA without CPU intervention.

View →
cs.AREmpiricalRecentJul 29, 2026

NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placement

Sookyung Choi, Seungyong Lee, Kangkyu Park, Yunseo Chun +10 more

This paper presents NELSSA, a serving system that integrates GPUs with Processing-near-Memory (PNM) devices to efficiently handle mixed-length workloads in LLMs, achieving up to 5.5x decode throughput…

View →
cs.PFcs.ARcs.DCRecentMay 27, 2026

Rotary GPU: Exploring Local Execution Paths for Large Mixture-of-Experts Models Under Limited GPU Memory

Myeong Jun Jo

The paper introduces Rotary GPU, an exploratory execution approach demonstrating that large Mixture-of-Experts models can be run locally on consumer GPUs with limited VRAM, achieving usable decode thr…

View →
cs.DCEmpiricalRecentOct 25, 2026

Cross-Modal Data Co-Locality for Heterogeneous Storage Systems

Abdullah Al-Mamun

Coloc is a storage-management layer that optimizes cross-modal access locality in distributed vector stores.

View →
cs.ARcs.CLcs.LGRecentJun 1, 2026

Multi-Segment Attention: Enabling Efficient KV-Cache Management for Faster Large Language Model Serving

Chunan Shi, Yilei Chen, Yilin Chen, Xupeng Miao +1 more

The paper proposes AsymCache, a computation-latency-aware KV cache management system that optimizes LLM inference by aligning cache eviction decisions with GPU attention kernel performance, significan…

View →