ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “policy optimization”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.LGstat.MLTheoreticalRecentJun 30, 2026

Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

Mingyi Li, Taira Tsuchiya, Kenji Yamanishi

This paper develops a new algorithm for policy optimization in online episodic tabular Markov decision processes with unknown transition kernels, providing data-dependent regret bounds and best-of-bot…

View →
cs.LGcs.AIcs.ROEmpiricalRecentOct 1, 2026

FERPO: Forward Entropy-Regularized Policy Optimization

Sebastian Sanokowski, Alireza Sarmadi, Majid Khadiv

This paper proposes a new reinforcement learning algorithm called Forward Entropy-Regularized Policy Optimization (FERPO) that improves policies without differentiating the critic with respect to acti…

View →
cs.LGcs.AIRecentMay 29, 2026

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks?

Stephane Hatgis-Kessell, Emma Brunskill

The paper introduces Prompted Policy Optimization (PromptPO), an LLM-based method that successfully optimizes policies for various sequential RL tasks, demonstrating that LLMs can replace classical RL…

View →
cs.PLmath.OCTheoreticalRecentJun 9, 2026

Max-Policy Iteration, Revisited

David Monniaux, Helmut Seidl

This paper improves max-policy iteration by replacing mathematical optimization with value iteration and proposes min-policy iteration as an alternative to linear programming.

View →
cs.LGcs.AIRecentMay 29, 2026

Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO

Yiming Ren, Yiran Xu, Zicheng Lin, Chufan Shi +7 more

The paper proposes S2L-PO, a framework that uses smaller, naturally diverse models as structured explorers to enhance the policy-level diversity and performance of larger language models during traini…

View →
cs.LGcs.AIcs.ROEmpiricalRecentNov 6, 2026

Ordered Policy Optimization

Dongkyu Derek Cho, Pan Xu

This paper proposes Ordered Policy Optimization (OPO), a modification to Proximal Policy Optimization that adapts the clipping radius to the reliability of the induced importance ratio distribution.

View →
cs.AIcs.LGRecentMay 30, 2026

Regularized Offline Policy Optimization with Posterior Hybrid Bayesian Belief

Hongqiang Lin, Pengfei Wang, Nenggan Zheng

The paper introduces Posterior Hybrid Bayesian Belief (PhyB), a novel framework that reformulates policy optimization in Bayesian Offline RL by approximating expectations as a convex combination over…

View →
cs.LGstat.MLRecentJun 1, 2026

Local Preferential Bayesian Optimization

Johanna Menn, Miriam Kober, Paul Brunzema, David Stenger +1 more

The paper introduces local Preferential Bayesian Optimization (PBO) methods that adapt high-dimensional Bayesian Optimization techniques, such as trust-region and derivative-informed local search, to…

View →
stat.MLcs.LGTheoreticalRecentJul 3, 2026

A Hierarchy of Policy Learning Problems

Hamsa Bastani, Osbert Bastani, Shihan Chen

This paper provides a mathematical framework for studying different policy learning problems and shows reductions between them.

View →
stat.MLcs.LGTheoreticalRecentJul 19, 2026

Non-Asymptotic Best Policy Identification Guarantees in Online Reinforcement Learning

Joseph Lazzaro, Alessio Russo, Aldo Pacchiano

This paper provides non-asytotic sample complexity guarantees for the Navigate and Stop algorithm in online tabular Reinforcement Learning, identifying additional attributes that affect the overall sa…

View →
cs.LGcs.MAEmpiricalRecentJul 30, 2026

Policy Gradient Steering: Interventions from Behavioral Objectives

Yoann Poupart, Aurélie Beynier, Nicolas Maudet

This paper proposes Policy Gradient Steering (PGS), a new method for dynamically changing a large language model's behavior at inference time using reinforcement learning.

View →
cs.AIcs.LGTheoreticalRecentAug 3, 2026

Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies

Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan, Anna Lukina

This paper introduces $k$-adaptable policy synthesis for optimizing a set of policies under uncertainty in Markov decision processes.

View →
stat.MLcs.LGmath.STTheoreticalRecentOct 20, 2026

Confessions of a Masked MDP

Sebastian Reboul, Lorenzo Croissant, Hélène Halconruy

This paper studies the problem of learning an optimal policy and the action mask in a linear MDP model.

View →
cs.MAcs.AIRecentMay 29, 2026

Safe Equilibrium Policy Optimization for Strategic Agent Policies

Karthika Arumugam, Kiran Kumar Manku, Amit Dhanda

The paper introduces Safe Equilibrium Policy Optimization (σepo{}) to train language models for multi-agent strategic tasks, achieving improved safety and robustness across various game domains.

View →
cs.LGcs.AIRecentMay 29, 2026

Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems

Jonathan Colaço Carr, Prakash Panangaden, Doina Precup, Benjamin Van Roy

The paper introduces the Markov decision contest, a new framework for reinforcement learning using pairwise preferences, and proves that stationary Markov policies are optimal and solvable efficiently…

View →
math.OCcs.LGcs.MATheoreticalRecentJul 1, 2026

Mean Field Reinforcement Learning

René Carmona, Mathieu Laurière

This paper introduces mean field reinforcement learning through Markov decision processes in large-population stochastic control, developing the necessary framework for representative-agent learning,…

View →