ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “Understanding of Markov Decision Processes”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

stat.MLcs.LGmath.STRecentJun 3, 2026

Bayesian learning for the stochastic shortest path problem

Chon Wai Ho, Sumeetpal S. Singh, Jiaqi Guo

The paper proposes a novel Bayesian framework to learn the optimal decision strategy for the stochastic shortest path problem by directly constructing the posterior beliefs for the action-value functi…

View →
stat.MLcs.LGTheoreticalRecentJul 19, 2026

Non-Asymptotic Best Policy Identification Guarantees in Online Reinforcement Learning

Joseph Lazzaro, Alessio Russo, Aldo Pacchiano

This paper provides non-asytotic sample complexity guarantees for the Navigate and Stop algorithm in online tabular Reinforcement Learning, identifying additional attributes that affect the overall sa…

View →
math.OCcs.LGcs.MATheoreticalRecentJul 1, 2026

Mean Field Reinforcement Learning

René Carmona, Mathieu Laurière

This paper introduces mean field reinforcement learning through Markov decision processes in large-population stochastic control, developing the necessary framework for representative-agent learning,…

View →
cs.LGcs.AIRecentMay 29, 2026

Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems

Jonathan Colaço Carr, Prakash Panangaden, Doina Precup, Benjamin Van Roy

The paper introduces the Markov decision contest, a new framework for reinforcement learning using pairwise preferences, and proves that stationary Markov policies are optimal and solvable efficiently…

View →
cs.LGstat.MLTheoreticalRecentJun 30, 2026

Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

Mingyi Li, Taira Tsuchiya, Kenji Yamanishi

This paper develops a new algorithm for policy optimization in online episodic tabular Markov decision processes with unknown transition kernels, providing data-dependent regret bounds and best-of-bot…

View →
cs.LGstat.MLRecentJun 1, 2026

Minimax-Optimal Policy Regret in Partially Observable Markov Games

Raman Arora

The paper develops an optimistic maximum-likelihood algorithm that achieves $ ilde{O}(\sqrt{T})$ policy regret for sequential decision-making in partially observable Markov games against adaptive oppo…

View →
cs.AIcs.LGcs.LORecentMay 29, 2026

Robust Shielding for Safe Reinforcement Learning

Edwin Hamel-De le Court, Thom Badings, Alessandro Abate, Francesco Belardinelli +1 more

The paper introduces a novel shielding framework for Robust MDPs (RMDPs) that guarantees safety under worst-case transition probabilities, enabling safe reinforcement learning even when transition dyn…

View →
cs.LGcs.AIstat.MLTheoreticalRecentJul 12, 2026

Learning from Local Walks on Dynamic Graphs with Bandit Feedback

Sourav Chakraborty, Amit Kiran Rege, Claire Monteleoni, Lijun Chen

This paper studies stochastic multi-armed bandits on dynamic graphs with local movement constraints and establishes sublinear expected regret.

View →
stat.MLcs.LGTheoreticalRecentJul 3, 2026

A Hierarchy of Policy Learning Problems

Hamsa Bastani, Osbert Bastani, Shihan Chen

This paper provides a mathematical framework for studying different policy learning problems and shows reductions between them.

View →
cs.LGcs.AIstat.MLRecentMay 28, 2026

The Sample Complexity of Multiclass and Sparse Contextual Bandits

Liad Erez, Fan Chen, Alon Cohen, Tomer Koren +3 more

The paper analyzes the sample complexity of contextual bandits in the $s$-sparse setting, achieving optimal sample bounds for identifying an $\epsilon$-optimal policy.

View →
cs.AIcs.LGRecentMay 27, 2026

Bridging the Sim-to-Real Gap in Reinforcement Learning-Based Industrial Dispatching through Execution Semantics

Jonathan Hoss, Noah Klarmann

The paper proposes a policy-neutral execution and measurement layer to mediate between reinforcement learning policies and industrial environments, transforming ambiguous execution failures into struc…

View →
cs.LGcs.AIstat.MLRecentMay 29, 2026

Why Linear Recurrent Memory Works in Partially Observable Reinforcement Learning

Yike Zhao, Onno Eberhard, Malek Khammassi, Ali H. Sayed +1 more

This paper theoretically justifies the strong performance of linear recurrent neural networks as memory units in partially observable reinforcement learning by constructing specific linear filters tha…

View →
stat.MLcs.AIcs.LGTheoreticalRecentJul 18, 2026

A Causal Markov Condition for Value

Olav Benjamin Vassend

This paper introduces the Value Causal Markov Condition (v-CMC) for linking causality and utility, and develops its foundations.

View →
cs.LOcs.AIcs.CRRecentApr 19, 2026

Atomic Decision Boundaries: A Structural Requirement for Guaranteeing Execution-Time Admissibility in Autonomous Systems

Marcelo Fernandez

The paper introduces the concept of the atomic decision boundary, proving that for autonomous systems to guarantee execution-time admissibility, the decision and the resulting state transition must oc…

View →
eess.SYcs.MAmath.OCTheoreticalRecentJun 22, 2026

Welfarist Control Design -- How to fulfill the societal mandate in multi-agent control?

Sophie Hall, Kai Zhang, Ilia Shilov, Heinrich H. Nax +1 more

This paper explores tools for control engineers to design socio-technical systems in a more principled and ethical manner, using feedback optimization, control of Markov decision processes, and model…

View →
cs.LGcs.AIRecentMay 29, 2026

Emergence of Exploration in Policy Gradient Reinforcement Learning via Retrying

Soichiro Nishimori, Paavo Parmas, Sotetsu Koyamada, Tadashi Kozuno +3 more

The paper introduces ReMax, a novel objective function that naturally encourages stochastic exploration in policy gradient reinforcement learning by evaluating expected maximum returns over multiple s…

View →
cs.ITcs.GTcs.NITheoreticalRecentJul 17, 2026

Strategic Persuasion Through Information Timeliness

Ahmet Bugra Gundogan, Melih Bastopcu

A paper on dynamic strategic communication problem where a sender controls the timing of truthful updates from binary Markov sources and aims to persuade the receiver to estimate the state as 1, while…

View →