Published August 2016
| Version v1
Journal article
Conditions for the Solvability of the Linear Programming Formulation for Constrained Discounted Markov Decision Processes
Creators
- 1. Institut de Mathématiques de Bordeaux, INRIA Bordeaux Sud Ouest, Team: CQFD, and IMB (France)
- 2. UNED, Department of Statistics and Operations Research (Spain)
Description
We consider a discrete-time constrained discounted Markov decision process (MDP) with Borel state and action spaces, compact action sets, and lower semi-continuous cost functions. We introduce a set of hypotheses related to a positive weight function which allow us to consider cost functions that might not be bounded below by a constant, and which imply the solvability of the linear programming formulation of the constrained MDP. In particular, we establish the existence of a constrained optimal stationary policy. Our results are illustrated with an application to a fishery management problem.
Additional details
Identifiers
Publishing Information
- Journal Title
- Applied Mathematics and Optimization
- Journal Volume
- 74
- Journal Issue
- 1
- Journal Page Range
- p. 27-51
- ISSN
- 0095-4616
INIS
- Country of Publication
- United States
- Country of Input or Organization
- International Atomic Energy Agency (IAEA)
- INIS RN
- 48064205
- Subject category
- S97: MATHEMATICAL METHODS AND COMPUTING;
- Descriptors DEI
- COMPACTS; FUNCTIONS; HYPOTHESIS; LINEAR PROGRAMMING; MANAGEMENT; MARKOV PROCESS
- Descriptors DEC
- CALCULATION METHODS; STOCHASTIC PROCESSES
Optional Information
- Copyright
- Copyright (c) 2016 Springer Science+Business Media New York
- Notes
- http://www.springer-ny.com