20 results for “Understanding of language models”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
The paper investigates compositional abilities in LLMs and humans using the Personal Relation Task, finding that LLMs excel at the structured (Intensional) task while humans are better at the real-wor…
This paper discusses the current understanding of Large Language Models (LLMs), their capabilities, and their relationship to human cognition, with a focus on emerging capabilities and mechanistic imp…
Mohammad Zeineldeen, Albert Zeyer, Haoran Zhang, Robin Schmitt +2 more
This paper investigates the relationship between language model perplexity and word error rate in modern automatic speech recognition systems, studying the impact of external language models, encoder…
Jing Peng, Junhao Du, Chenghao Wang, Hanqi Li +20 more
The paper introduces SURE, a unified framework designed to standardize and improve the comparability and reproducibility of evaluations for advanced speech understanding models.
The paper introduces Mental Model Management (3M), a framework for representing knowledge as compact mental models and continuously integrating new information.
The paper proposes Large Language Gibbs, a scheme for structured probabilistic inference using conditional distributions of large language models as transition operators.
Kevin Cheang, Geoff Hulette, Rahul Kumar, Felipe R. Monteiro +4 more
An agent called Autogrammar is introduced to automatically learn context-free grammars for domain-specific languages, enabling grammar-constrained decoding and improving language model performance.
The authors propose a Transformer variant that separates state prediction from next token prediction to improve language modeling performance.
The paper argues that large language models (LLMs) are a special case of world models and proposes a continuous spectrum between token prediction and latent-space architectures.
The paper proposes CYKNN, a novel recurrent neural network architecture that directly encodes the CYK parsing algorithm, demonstrating superior performance over large language models on syntactic pars…
This paper proposes Chained Recursive Language Models (Chained RLM), an inference-time architecture for managing context in large language models, allowing for intermediate artifacts to be inspected,…
This paper investigates the relationship between lexical diversity and intrinsic dimensionality in language models.
Minhua Lin, Zijun Wang, Zewen Liu, Zhaotian Weng +6 more
This paper proposes a method, LM2LM, to train large language models to generate effective improvement proposals using reinforcement learning and a research world model.
ProbScale is a novel framework that combines neural scaling laws and language model probing to identify highly efficient, task-specific subnetworks within pre-trained Small Language Models, achieving…
Zhilin Guo, Boqiao Zhang, Hakan Aktas, Kyle Fogarty +13 more
This paper introduces a Telescopic Language Model (TLM) that can serve multiple compute budgets with a single training run.
The paper enhances French parsing accuracy by integrating data from a syntactic lexicon and applying word clustering methods to verbs within a Probabilistic Context-Free Grammar framework.