ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “large-scale model training”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.DCcs.AIEmpiricalRecentJun 9, 2026

Piper: A Programmable Distributed Training System

Megan Frisella, Shubham Tiwari, Andy Ruan, Yi Pan +4 more

Piper is a user-controllable distributed training system that decouples the strategy from the runtime implementation, allowing users to declare a comprehensive distributed training strategy with a sma…

View →
cs.DCEmpiricalRecentOct 16, 2026

BaGuaLu-2: Taming Dynamic Memory Fluctuation for Efficient MoE Model Training over 10,000 GPUs

Mingshu Zhai, Minkun Guo, Hongrui Lian, Shuangyu Li +6 more

BaGuaLu-2 proposes a flexible memory provisioning system for large language models

View →
cs.CVRecentJun 1, 2026

LL-Bench: Rethinking Low-Level Vision Evaluation in the Era of Large-Scale Generative Models

Lu Liu, Huiyu Duan, Chenxin Zhu, Jintong Lu +5 more

The paper introduces LL-Bench, a comprehensive benchmark for evaluating large-scale generative models on low-level vision tasks, and proposes LL-Score, an MLLM-based evaluator that better aligns quali…

View →
cs.DCEmpiricalRecentJul 2, 2026

Arachne: Orchestrating Cascades for Efficient Text-to-Video Model Training

Peng Yu, Yuankai Fan, Yang Qiu, Tian Li +3 more

This paper introduces Arachne, a framework for efficient Text-to-Video model training at scale, reducing iteration time by up to 65% over leading frameworks.

View →
cs.CVcs.AIRecentJun 1, 2026

Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks

Nermeen Abou Baker, David Rohrschneider, Uwe Handmann

This paper investigates the application of Parameter-Efficient Fine-Tuning (PEFT) methods, specifically adapters and LoRA, to large pretrained models for instance segmentation, demonstrating that thes…

View →
cs.CVcs.AIcs.MMEmpiricalRecentJul 10, 2026

Scalable Visual Pretraining for Language Intelligence

Yiming Zhang, Zhonghan Zhao, Wenwei Zhang, Haiteng Zhao +12 more

This paper presents the benefits of visual pretraining for foundation model intelligence, outperforming text-only pretraining on multiple backbones and benchmarks.

View →
cs.LGcs.CVEmpiricalRecentOct 19, 2026

Text-to-Image Generative Modeling Without Language Pretraining

Keshigeyan Chandrasegaran, Yue Zhao, Armin W. Thomas, Ehsan Adeli +4 more

The paper presents a new text-to-image generation model, Halcyon, that can be trained from scratch without internet-scale language pretraining.

View →
cs.LGcs.AIEmpiricalRecentOct 14, 2026

Your Transformer Is Secretly Elastic

Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts, Cees G. M. Snoek

The paper introduces a retraining-free method to elastify pre-trained transformers into a single model that adapts to varying computational budgets.

View →
cs.CVcs.AIRecentMay 28, 2026

GPIC: A Giant Permissive Image Corpus for Visual Generation

Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal, Michael Jang +5 more

The paper introduces GPIC, a massive, permissively licensed, and safety-filtered image corpus of 28 trillion pixels, designed to serve as a stable and accessible benchmark for large-scale visual gener…

View →
cs.LGcs.AIcs.AREmpiricalRecentJun 22, 2026

The Energy Consumption of Transformer Fine-Tuning: A Roofline-Inspired Scaling Model

Mansour Zoubeirou a Mayaki

The paper presents a framework to model and predict energy consumption of Transformer training on multiple GPUs.

View →
cs.DCcs.AIEmpiricalRecentJul 2, 2026

Mixture-of-Parallelisms: Towards Memory-Efficient Training Stack for Mixture-of-Experts Models

Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao, Semih Yavuz +2 more

This paper presents a memory-efficient training stack for Mixture-of-Experts (MoE) models, combining and specializing parallelism techniques for maximal efficiency.

View →
cs.CLcs.AIEmpiricalRecentOct 16, 2026

Language Models Learn to Improve Language Models

Minhua Lin, Zijun Wang, Zewen Liu, Zhaotian Weng +6 more

This paper proposes a method, LM2LM, to train large language models to generate effective improvement proposals using reinforcement learning and a research world model.

View →
cs.CVcs.AIRecentMay 27, 2026

FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales

Jorge L. Rodriguez, Victor Angulo Morales, Areej Alwahas, Mariana Elias Lara +5 more

FLORO is a multimodal geospatial foundation model that learns transferable remote sensing representations from a small, diverse corpus, achieving strong performance across various sensor types and res…

View →
cs.LGcs.AIstat.MLRecentMay 28, 2026

CalArena: A Large-Scale Post-Hoc Calibration Benchmark

Eugène Berta, David Holzmüller, Francis Bach, Michael I. Jordan

The paper introduces CalArena, a large-scale, standardized benchmark covering nearly 2000 experiments to comprehensively evaluate post-hoc calibration methods, finding that smooth calibration function…

View →
cs.LGTheoreticalRecentOct 16, 2026

How Finite-Rank Bottlenecks Shape the Low-Rank Adaptation Landscape

Long Nguyen-Chi, Quynh Nguyen, Thanh Nguyen-Cung, Binh T. Nguyen

This paper provides a theoretical explanation for why low-rank adaptation (LoRA) is effective in fine-tuning large pretrained models.

View →
cs.LGcs.AIcs.CVRecentMay 30, 2026

On the Difficulty of Learning a Meta-network for Training Data Selection

Zilin Du, Junqi Zhao, Boyang Albert Li

This paper analyzes the poor performance of Meta-learning for Training-data Selection (MTS) and proposes that increasing the batch size and incorporating informative features can significantly improve…

View →