ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “Pretrained models”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.DCcs.AIEmpiricalRecentJun 9, 2026

Piper: A Programmable Distributed Training System

Megan Frisella, Shubham Tiwari, Andy Ruan, Yi Pan +4 more

Piper is a user-controllable distributed training system that decouples the strategy from the runtime implementation, allowing users to declare a comprehensive distributed training strategy with a sma…

View →
cs.LGcs.AIcs.CLEmpiricalRecentJun 9, 2026

A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design

Tong Xie, Yuanhao Ban, Yunqi Hong, Sohyun An +2 more

This paper reinterprets supervised fine-tuning as target distribution design and proposes a new method called Target-SFT that constructs the training objective directly from the desired target distrib…

View →
cs.LGcs.AIEmpiricalRecentJun 4, 2026

PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training

Senmiao Wang, Tiantian Fang, Haoran Zhang, Yushun Zhang +3 more

This paper proposes a preconditioning layer for stable weight conditioning in LLM training.

View →
cs.LGstat.MLTheoreticalRecentOct 16, 2026

Minimax-optimal Scaling Laws in Ridge Regression via Transfer Learning

Yalda Shabanzadeh, Diyuan Wu, Marco Mondelli

The paper investigates the performance improvement of transfer learning in high-dimensional regression.

View →
cs.CVcs.AIRecentJun 1, 2026

Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks

Nermeen Abou Baker, David Rohrschneider, Uwe Handmann

This paper investigates the application of Parameter-Efficient Fine-Tuning (PEFT) methods, specifically adapters and LoRA, to large pretrained models for instance segmentation, demonstrating that thes…

View →
cs.LGcs.CVEmpiricalRecentOct 19, 2026

Text-to-Image Generative Modeling Without Language Pretraining

Keshigeyan Chandrasegaran, Yue Zhao, Armin W. Thomas, Ehsan Adeli +4 more

The paper presents a new text-to-image generation model, Halcyon, that can be trained from scratch without internet-scale language pretraining.

View →
cs.CVcs.AIcs.MMEmpiricalRecentJul 10, 2026

Scalable Visual Pretraining for Language Intelligence

Yiming Zhang, Zhonghan Zhao, Wenwei Zhang, Haiteng Zhao +12 more

This paper presents the benefits of visual pretraining for foundation model intelligence, outperforming text-only pretraining on multiple backbones and benchmarks.

View →
cs.LGcs.AIcs.CVRecentMay 30, 2026

On the Difficulty of Learning a Meta-network for Training Data Selection

Zilin Du, Junqi Zhao, Boyang Albert Li

This paper analyzes the poor performance of Meta-learning for Training-data Selection (MTS) and proposes that increasing the batch size and incorporating informative features can significantly improve…

View →
cs.LGEmpiricalRecentJul 29, 2026

Do You Really Need to Pretrain Q-Functions for Online RL Fine-Tuning?

Perry Dong, Ron Polonsky, Dorsa Sadigh, Chelsea Fin

This paper studies the effectiveness of pretraining the Q-function in value-based reinforce learning and finds that naive Q-function pretraining often provides little benefit over random initializatio…

View →
cs.LGRecentJun 1, 2026

TabPrep: Closing the Feature Engineering Gap in Tabular Benchmarks

Andrej Tschalzev, Nick Erickson, Yuyang Wang, Huzefa Rangwala +3 more

The paper introduces TabPrep, a feature engineering pipeline that systematically improves performance across various tabular machine learning models by addressing structural data patterns ignored by c…

View →
cs.LGcs.AIcs.CVRecentJun 4, 2026

In-Context Multiple Instance Learning

Alexander Möllers, Marvin Sextro, Julius Hense, Gabriel Dernbach +1 more

The paper proposes pretraining a Perceiver-style in-context learner on synthetic data to solve Multiple Instance Learning (MIL) tasks efficiently in the low-label regime.

View →
cs.CRcs.LGApr 9, 2026

Improving DNS Exfiltration Detection via Transformer Pretraining

Miloš Tomić, Aleksa Cvetanović, Predrag Tadić

This paper demonstrates that in-domain pretraining of BERT significantly improves the detection of DNS exfiltration, particularly in maintaining a low false positive rate.

View →
cs.LGcs.AIRecentMay 29, 2026

From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets

Zakk Heile, Hayden McTavish, Varun Babbar, Margo Seltzer +1 more

The paper introduces PRAXIS, a novel algorithm that efficiently approximates the computation of 'Rashomon sets' for decision trees, significantly reducing memory and runtime complexity.

View →
cs.SDcs.AIEmpiricalRecentJun 23, 2026

ZONOS2 Technical Report

Gabriel Clark, Sofian Mejjoute, Mohamed Osman, George Close +1 more

The authors present ZONOS2 8B, a TTS model with improved naturalness, prosody, and voice cloning fidelity, achieved through scaling, data expansion, and simplification.

View →
cs.LGcs.AIRecentMay 27, 2026

Efficient Pre-Training of LLMs through Truncated SVD Layers

Kaivan Kamali, Kajetan Schweighofer, Hormoz Shahrzad, Olivier Francon +2 more

The paper introduces TSVD, a novel framework that efficiently pre-trains LLMs by enforcing both low rank and strict weight orthonormality, achieving performance comparable to full-parameter models wit…

View →