ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “Markov Decision Process”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.LGmath.OCmath.PREmpiricalRecentJun 9, 2026

Data-Driven Dynamic Assortment in Online Platforms: Learning about Two Sides

Rahul Roy, Nur Sunar, Jayashankar M. Swaminathan

This paper studies a dynamic assortment problem on a two-sided service platform with incomplete information and heterogeneous customers, and develops a data-driven algorithm to learn parameters and op…

View →
stat.MLcs.LGmath.STRecentJun 3, 2026

Bayesian learning for the stochastic shortest path problem

Chon Wai Ho, Sumeetpal S. Singh, Jiaqi Guo

The paper proposes a novel Bayesian framework to learn the optimal decision strategy for the stochastic shortest path problem by directly constructing the posterior beliefs for the action-value functi…

View →
stat.MLcs.LGTheoreticalRecentJul 19, 2026

Non-Asymptotic Best Policy Identification Guarantees in Online Reinforcement Learning

Joseph Lazzaro, Alessio Russo, Aldo Pacchiano

This paper provides non-asytotic sample complexity guarantees for the Navigate and Stop algorithm in online tabular Reinforcement Learning, identifying additional attributes that affect the overall sa…

View →
cs.LGcs.AIRecentMay 29, 2026

Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems

Jonathan Colaço Carr, Prakash Panangaden, Doina Precup, Benjamin Van Roy

The paper introduces the Markov decision contest, a new framework for reinforcement learning using pairwise preferences, and proves that stationary Markov policies are optimal and solvable efficiently…

View →
math.OCcs.LGcs.MATheoreticalRecentJul 1, 2026

Mean Field Reinforcement Learning

René Carmona, Mathieu Laurière

This paper introduces mean field reinforcement learning through Markov decision processes in large-population stochastic control, developing the necessary framework for representative-agent learning,…

View →
cs.LGstat.MLRecentJun 1, 2026

Minimax-Optimal Policy Regret in Partially Observable Markov Games

Raman Arora

The paper develops an optimistic maximum-likelihood algorithm that achieves $ ilde{O}(\sqrt{T})$ policy regret for sequential decision-making in partially observable Markov games against adaptive oppo…

View →
cs.LGstat.MLTheoreticalRecentJun 30, 2026

Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

Mingyi Li, Taira Tsuchiya, Kenji Yamanishi

This paper develops a new algorithm for policy optimization in online episodic tabular Markov decision processes with unknown transition kernels, providing data-dependent regret bounds and best-of-bot…

View →
cs.AIcs.LGcs.LORecentMay 29, 2026

Robust Shielding for Safe Reinforcement Learning

Edwin Hamel-De le Court, Thom Badings, Alessandro Abate, Francesco Belardinelli +1 more

The paper introduces a novel shielding framework for Robust MDPs (RMDPs) that guarantees safety under worst-case transition probabilities, enabling safe reinforcement learning even when transition dyn…

View →
cs.LGcs.AIstat.MLRecentMay 28, 2026

The Sample Complexity of Multiclass and Sparse Contextual Bandits

Liad Erez, Fan Chen, Alon Cohen, Tomer Koren +3 more

The paper analyzes the sample complexity of contextual bandits in the $s$-sparse setting, achieving optimal sample bounds for identifying an $\epsilon$-optimal policy.

View →
cs.AIcs.LGecon.THRecentMay 31, 2026

Prospect-Theory Behavior from Bellman Optimality in MDPs with Catastrophic States

Yujiao Chen

This paper shows that standard optimal control in Markov Decision Processes (MDPs) with an absorbing catastrophic state naturally generates behavioral signatures mimicking prospect theory, even withou…

View →
stat.MLcs.AIcs.LGTheoreticalRecentJul 18, 2026

A Causal Markov Condition for Value

Olav Benjamin Vassend

This paper introduces the Value Causal Markov Condition (v-CMC) for linking causality and utility, and develops its foundations.

View →
cs.ITcs.GTcs.NITheoreticalRecentJul 17, 2026

Strategic Persuasion Through Information Timeliness

Ahmet Bugra Gundogan, Melih Bastopcu

A paper on dynamic strategic communication problem where a sender controls the timing of truthful updates from binary Markov sources and aims to persuade the receiver to estimate the state as 1, while…

View →
eess.SYcs.MAmath.OCTheoreticalRecentJun 22, 2026

Welfarist Control Design -- How to fulfill the societal mandate in multi-agent control?

Sophie Hall, Kai Zhang, Ilia Shilov, Heinrich H. Nax +1 more

This paper explores tools for control engineers to design socio-technical systems in a more principled and ethical manner, using feedback optimization, control of Markov decision processes, and model…

View →
cs.LGcs.AIstat.MLTheoreticalRecentJul 12, 2026

Learning from Local Walks on Dynamic Graphs with Bandit Feedback

Sourav Chakraborty, Amit Kiran Rege, Claire Monteleoni, Lijun Chen

This paper studies stochastic multi-armed bandits on dynamic graphs with local movement constraints and establishes sublinear expected regret.

View →
cs.LGcs.AIRecentMay 29, 2026

From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets

Zakk Heile, Hayden McTavish, Varun Babbar, Margo Seltzer +1 more

The paper introduces PRAXIS, a novel algorithm that efficiently approximates the computation of 'Rashomon sets' for decision trees, significantly reducing memory and runtime complexity.

View →
cs.AIcs.LGRecentMay 27, 2026

Bridging the Sim-to-Real Gap in Reinforcement Learning-Based Industrial Dispatching through Execution Semantics

Jonathan Hoss, Noah Klarmann

The paper proposes a policy-neutral execution and measurement layer to mediate between reinforcement learning policies and industrial environments, transforming ambiguous execution failures into struc…

View →
math.OCcs.AIcs.LGRecentJun 1, 2026

MINTS: Minimalist Thompson Sampling

Kaizheng Wang

The paper introduces MINTS, a minimalist Bayesian framework that simplifies sequential decision-making by placing priors only on the optimum location, allowing for the incorporation of structural cons…

View →