ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “preference learning”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.LGmath.OCmath.PREmpiricalRecentJun 9, 2026

Data-Driven Dynamic Assortment in Online Platforms: Learning about Two Sides

Rahul Roy, Nur Sunar, Jayashankar M. Swaminathan

This paper studies a dynamic assortment problem on a two-sided service platform with incomplete information and heterogeneous customers, and develops a data-driven algorithm to learn parameters and op…

View →
cs.LGcs.AIRecentMay 31, 2026

Efficient Exploration for Iterative Nash Preference Optimization

Tianlong Nan, Xiaopeng Li, Christian Kroer, Tianyi Lin

The paper proposes a novel, explicitly exploratory iterative Nash Learning from Human Feedback (NLHF) algorithm that achieves strong regret bounds for optimizing LLMs based on complex, non-scalar huma…

View →
stat.MLcs.AIcs.LGRecentMay 28, 2026

Reward Learning from Best-of-$N$ Preference Data: Targets, Tradeoffs, and Design Principles

Rattana Pukdee, Maria-Florina Balcan, Pradeep Ravikumar

This paper analyzes Best-of-$N$ preference data, deriving explicit reward targets for independent-reference variants and establishing design principles for choosing $N$ and the base distribution to op…

View →
cs.LGcs.AIcs.DCRecentMay 29, 2026

Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences

Jabin Koo, Hoyoung Kim, Minwoo Jang, Jungseul Ok

The paper proposes FedVPA-GP, a federated learning framework that uses a Gumbel-Softmax prior and orthogonal loss to personalize LLM alignment by disentangling conflicting user preferences while maint…

View →
cs.LGcs.AIRecentMay 28, 2026

In-Context Reward Adaptation for Robust Preference Modeling

Zhenyu Sun, Zheng Xu, Ermin Wei

The paper proposes In-Context Reward Adaptation, a transformer-based framework that uses in-context learning and auxiliary signals (like human response time) to robustly model diverse and unseen human…

View →
cs.LGcs.AIcs.ROEmpiricalRecentJun 17, 2026

UBP2: Uncertainty-Balanced Preference Planning for Efficient Preference-based Reinforcement Learning

Mohamed Nabail, Leo Cheng, Jingmin Wang, Nicholas Rhinehart

One clear sentence describing what this paper does

View →
cs.CVEmpiricalRecentJun 12, 2026

S$^2$COPE: Self-Supervised Concept Discovery via Preference Learning

Shilong Xiang, Zirui Zhang, Chengzhi Mao

This paper introduces a self-supervised framework for discovering novel, structured concepts from raw imagery without human annotation.

View →
cs.LGstat.MLRecentJun 1, 2026

Local Preferential Bayesian Optimization

Johanna Menn, Miriam Kober, Paul Brunzema, David Stenger +1 more

The paper introduces local Preferential Bayesian Optimization (PBO) methods that adapt high-dimensional Bayesian Optimization techniques, such as trust-region and derivative-informed local search, to…

View →
cs.CLcs.AIRecentMay 29, 2026

Isolating LLM Lexical Bias: A Curation-Free Triangulated Metric for Preference-Stage Learning

Xiaoyang Ming, Jose Hernandez, Thomas Stephan Juzek

The paper introduces the Triangulated Preference Shift score, an automated, curation-free metric to quantify systematic lexical biases introduced into Large Language Models during the preference-learn…

View →
cs.LGcs.ROEmpiricalRecentSep 23, 2026

Context-Continuous Preference Learning for Exoskeleton Personalization

Sunin Baek, Sungwoo Park, Daekyum Kim

The paper proposes a method called Context-Continuous Preference Learning (CCPL) to personalize exoskeleton assistance across different operating conditions with limited user feedback.

View →
cs.IRcs.AIEmpiricalRecentJun 16, 2026

Temporal Preference Optimization for Unsupervised Retrieval

HyunJin Kim, Jaejun Shim, Young Jin Kim, JinYeong Bak

This paper proposes TPOUR, a novel unsupervised retriever that captures temporal relevance in document collections.

View →
cs.CLRecentMay 29, 2026

Preference-Aware Rubric Learning for Personalized Evaluation

Yilun Qiu, Xiaoyan Zhao, Yang Zhang, Yuxin Chen +6 more

The paper introduces PARL, a framework that learns personalized evaluation rubrics directly from raw user interaction histories to accurately assess how well LLM outputs align with subjective, user-sp…

View →
cs.CRcs.AIcs.LGRecentMay 29, 2026

Differentially Private Preference Data Synthesis for Large Language Model Alignment

Fengyu Gao, Jing Yang

The paper introduces DPPrefSyn, a novel algorithm that generates differentially private synthetic preference data, enabling privacy-preserving alignment of large language models.

View →
cs.CRcs.AIcs.LGRecentMay 29, 2026

Differentially Private Preference Data Synthesis for Large Language Model Alignment

Fengyu Gao, Jing Yang

The paper introduces DPPrefSyn, a novel algorithm that generates differentially private synthetic preference data, enabling privacy-preserving alignment of large language models.

View →
cs.IREmpiricalRecentSep 18, 2026

Adaptive Preference Modeling via Explicit Indirect Relational Learning for Personalized Fashion Matching

Shuiying Liao, Li Li, P. Y. Mok

This paper proposes a framework for personalized fashion recommendations that models direct and indirect user and item relationships.

View →
cs.MAcs.AIEmpiricalRecentJun 12, 2026

Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning

Pengxin Wang, Lihao Guo, Yi Xie, Bo Liu +2 more

This paper proposes a new method for cooperative multi-objective multi-agent reinforcement learning that learns agent-specific preferences to improve team performance and trade-off coordination.

View →
cs.LGcs.AIRecentMay 29, 2026

Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems

Jonathan Colaço Carr, Prakash Panangaden, Doina Precup, Benjamin Van Roy

The paper introduces the Markov decision contest, a new framework for reinforcement learning using pairwise preferences, and proves that stationary Markov policies are optimal and solvable efficiently…

View →
cs.LGcs.CVRecentJun 1, 2026

Drifting Preference Optimization for One-Step Generative Models

Zhou Jiang, Yandong Wen, Zhen Liu

The paper introduces Drifting Preference Optimization (DrPO), an efficient online method for preference finetuning one-step text-to-image generators that avoids complex gradient calculations and model…

View →
cs.LGcs.MAEmpiricalRecentJun 26, 2026

Democratic ICAI: Debating Our Way to Steering Principles from Preferences

Kevin Kingslin, Anish Natekar, Ashutosh Ranjan, Vivek Srivastava +2 more

This paper introduces Democratic ICAI, an approach to summarize preferences into natural-language principles through structured persona debate, yielding clearer and more comprehensive steering princip…

View →
eess.AScs.CLcs.SDEmpiricalRecentJun 26, 2026

HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech

Sihang Nie, Xiaofen Xing, Rui Xing, Haoming Li +4 more

This paper proposes HPRO, a hierarchical progressive reward optimization framework for Large Language Model-based Text-to-Speech, to overcome the information conflict and scale gap issues.

View →