ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “Small Language Model”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.CLcs.AIEmpiricalRecentJun 19, 2026

Evaluation of Small Language Models for Arabic Language Processing

Jumana Alsubhi, Ahmed Alhusayni, Abdulrahman Gharawi, Israa Hamdine +4 more

This paper evaluates the performance of twelve Small Language Models on Arabic natural language processing tasks.

View →
cs.CLcs.AIcs.LGRecentJun 1, 2026

ProbeScale: Probing Analysis to Optimize Neural Scaling Laws for Efficient Small Language Model Inference

Sourav Das

ProbScale is a novel framework that combines neural scaling laws and language model probing to identify highly efficient, task-specific subnetworks within pre-trained Small Language Models, achieving…

View →
cs.CLcs.AIcs.LGRecentMay 30, 2026

Short-form Text Rewriting with Phi Silica

Divya Tadimeti, Shawn Pan, Sameera Lanka, Chenghui Zhou +1 more

This paper demonstrates that targeted adaptation of the small language model Phi Silica, using dataset curation and fine-tuning, significantly improves its performance in short-form text rewriting, na…

View →
cs.CRcs.AIMay 7, 2026

Fine-Tuning Small Language Models for Solution-Oriented Windows Event Log Analysis

Siraaj Akhtar, Saad Khan, Simon Parkinson

This paper demonstrates that fine-tuning small language models (SLMs) on a synthetic, solution-rich Windows event log dataset allows them to outperform larger LLMs in identifying issues and providing…

View →
cs.CLcs.LGEmpiricalRecentJun 21, 2026

Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

Despina Christou, Grigorios Tsoumakas

This paper investigates the performance of small language models in relation extraction tasks, showing that task-specific adaptation can enable them to outperform larger, general-purpose models.

View →
cs.CLcs.AIcs.LGRecentMay 27, 2026

Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts

Liu O. Martin, Lucas Bandarkar, Nanyun Peng

The paper proposes an aggressive, parameter-efficient method to prune non-essential experts from Mixture-of-Experts (MoE) LLMs, significantly compressing the model while maintaining high machine trans…

View →
cs.CLcs.LGEmpiricalRecentJun 19, 2026

CAT-Translate: Building Compact Open-Source Models for Japanese-English Translation

Yuu Jinnai

Develops specialized Japanese-English translation models for real-world translation tasks.

View →
cs.CLcs.AIEmpiricalRecentSep 28, 2026

Telescopic Language Models

Zhilin Guo, Boqiao Zhang, Hakan Aktas, Kyle Fogarty +13 more

This paper introduces a Telescopic Language Model (TLM) that can serve multiple compute budgets with a single training run.

View →
cs.CLEmpiricalRecentJul 24, 2026

A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books

Varun Ghat Ravikumar, Sina Ahmadi, Lena Jäger, Rico Sennrich

This paper introduces a pipeline to extract grammatical rules, example sentences, and lexicons from grammar books and generates synthetic parallel corpora for fine-tuning machine translation models on…

View →
cs.CLcs.AIeess.ASEmpiricalRecentOct 27, 2026

Developing a Speech Language Model for Basque

Andoni Sudupe, Inma Hernaez, Ander Arriandiaga, Christoforos Souganidis +2 more

Developed the first open Speech Language Model for Basque for low-latency, end-to-end spoken interaction.

View →
cs.CLRecentJun 1, 2026

PortBERT: Navigating the Depths of Portuguese Language Models

Raphael Scheible-Schmitt, Henry He, Armando B. Mendes

The paper introduces PortBERT, a family of RoBERTa-based language models for Portuguese, which achieves competitive performance while explicitly balancing efficiency and accuracy.

View →
cs.LGEmpiricalRecentSep 25, 2026

Weight Pair Encoding: Inducing a Smaller Grammar in Neural Network Weights

Irene Tallini, Daniele Solombrino, Alberto Cazzaniga, Emanuele Rodolà

This paper introduces Weight Pair Encoding, a method to explicitly finetune neural network weights to admit a smaller grammar.

View →
cs.CLcs.AIEmpiricalRecentOct 16, 2026

Language Models Learn to Improve Language Models

Minhua Lin, Zijun Wang, Zewen Liu, Zhaotian Weng +6 more

This paper proposes a method, LM2LM, to train large language models to generate effective improvement proposals using reinforcement learning and a research world model.

View →
cs.CLEmpiricalRecentJun 22, 2026

Self-Compacting Language Model Agents

Tianjian Li, Jingyu Zhang, William Jurayj, Xi Wang +4 more

This paper proposes SelfCompact, a scaffold that allows models to decide when and how to compact long agent traces, improving summarization at a lower token cost.

View →
cs.CLcs.AIcs.LGEmpiricalRecentJun 11, 2026

SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation

Marek Šuppa, Andrej Ridzik, Daniel Hládek, Natália Kňažeková +1 more

This paper introduces SkMTEB, a comprehensive text embedding benchmark for Slovak, and develops efficient, locally-deployable Slovak embeddings.

View →
cs.CLRecentMay 30, 2026

OCC-RAG: Optimal Cognitive Core for Faithful Question Answering

Maksim Savkin, Mikhail Goncharov, Alexander Gambashidze, Alla Chepurova +6 more

The paper introduces OCC-RAG, a family of compact, task-specialized Small Language Models (SLMs) designed to achieve highly faithful, multi-hop question answering grounded strictly in provided context…

View →