Published August 2016 | Version v1
Journal article

Conditions for the Solvability of the Linear Programming Formulation for Constrained Discounted Markov Decision Processes

  • 1. Institut de Mathématiques de Bordeaux, INRIA Bordeaux Sud Ouest, Team: CQFD, and IMB (France)
  • 2. UNED, Department of Statistics and Operations Research (Spain)

Description

We consider a discrete-time constrained discounted Markov decision process (MDP) with Borel state and action spaces, compact action sets, and lower semi-continuous cost functions. We introduce a set of hypotheses related to a positive weight function which allow us to consider cost functions that might not be bounded below by a constant, and which imply the solvability of the linear programming formulation of the constrained MDP. In particular, we establish the existence of a constrained optimal stationary policy. Our results are illustrated with an application to a fishery management problem.

Additional details

Identifiers

Publishing Information

Journal Title
Applied Mathematics and Optimization
Journal Volume
74
Journal Issue
1
Journal Page Range
p. 27-51
ISSN
0095-4616

INIS

Country of Publication
United States
Country of Input or Organization
International Atomic Energy Agency (IAEA)
INIS RN
48064205
Subject category
S97: MATHEMATICAL METHODS AND COMPUTING;
Descriptors DEI
COMPACTS; FUNCTIONS; HYPOTHESIS; LINEAR PROGRAMMING; MANAGEMENT; MARKOV PROCESS
Descriptors DEC
CALCULATION METHODS; STOCHASTIC PROCESSES

Optional Information

Copyright
Copyright (c) 2016 Springer Science+Business Media New York
Notes
http://www.springer-ny.com