20 results for “Understanding of serverless computing, large language models, energy optimization, scheduling”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
This paper proposes a dependency-aware autoscaling framework for serverless computing, integrating graph-based bottleneck identification, short-term workload forecasting, multi-model consensus, and co…
This paper presents Festina, a profiling-guided, power-aware control plane for minimizing energy consumption in serverless large language model (LLM) serving.
Yuanhe Zhang, Xinyue Wang, Zhican Chen, Weiliu Wang +7 more
This survey systematically reviews resource consumption threats in large language models (LLMs) to provide a unified view of the problem landscape, from threat induction to mitigation.
Wei Shao, Khaled Khasawneh, Setareh Rafatirad, Houman Homayoun +1 more
The paper introduces Kumo, a novel security-focused simulator that enables controlled analysis of resource sharing and scheduling risks in serverless cloud environments, demonstrating that scheduler c…
This paper argues that idle cores on contemporary multicore processors can return compute capacity and proposes a budget-centric view of service core systems.
ALPS is an automated, vendor-agnostic framework that enforces least privilege in serverless functions by analyzing code and generating precise security policies, achieving high coverage and significan…
This paper studies the autarky problem of scheduling energy-consuming jobs with time windows using a battery and an energy forecast, and shows NP-hardness, polynomial-time solvability, and fixed-param…
This paper proposes a carbon-aware routing policy for geo-distributed cloud deployments, achieving up to 46.8% carbon reduction while maintaining zero SLA violations.
Dilina Dehigama, Shyam Jesalpura, Zeyu Xu, Marton Nemeth +3 more
The paper introduces Spandana, an architecture that decouples SLO enforcement from cost optimization in cloud-based online services, achieving high utilization, strict SLO adherence, and cost savings.
Thomas Badts, Tim Boyle, Claudio Carvalho, Antonio Córcoles +24 more
The paper presents the Quantum Resource Management Interface (QRMI) as a standardized, vendor-agnostic middleware layer for integrating quantum resources into high-performance computing environments,…
The paper introduces Hyperparam, a set of lightweight JavaScript libraries designed to enable direct, model-aware querying of unstructured data (like agent traces) within client-side AI applications.
This paper introduces BigPower, a hierarchical source-level surrogate model for fine-grained module-level power estimation during CPU design using large language models and architectural hierarchy.
The paper proposes a method to improve the performance of fine-grained offloads on servers by overlapping the offload with other requests using server-side routing.
The paper proposes a conservative extension of Lustre's clock calculus to facilitate the embedding of ML models in reactive applications.
The paper proposes $D^3$, a dynamic graph-constrained scheduling framework that optimizes LLM training order by modeling sample interactions as a dynamic influence graph.
Shiguo Lian, Kai Wang, Zhaoxiang Liu, Wen Liu +21 more
This paper proposes a four-layer technical architecture for large model inference optimization, including Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion…
Hai Duc Nguyen, Tekin Bicer, Kyle Chard, Ian Foster +1 more
Researchers used a large language model to generate checkpoint/restart code for MPI applications, achieving comparable efficiency to human-engineered solutions.