Published August 2012 | Version v1
Journal article

Tail-constraining stochastic linear–quadratic control: a large deviation and statistical physics approach

  • 1. Center for Nonlinear Studies and Theoretical Division at LANL, and New Mexico Consortium, Los Alamos, NM (United States)

Description

The standard definition of the stochastic risk-sensitive linear–quadratic (RS-LQ) control depends on the risk parameter, which is normally left to be set exogenously. We reconsider the classical approach and suggest two alternatives, resolving the spurious freedom naturally. One approach consists in seeking for the minimum of the tail of the probability distribution function (PDF) of the cost functional at some large fixed value. Another option suggests minimizing the expectation value of the cost functional under a constraint on the value of the PDF tail. Under the assumption of resulting control stability, both problems are reduced to static optimizations over a stationary control matrix. The solutions are illustrated using the examples of scalar and 1D chain (string) systems. The large deviation self-similar asymptotic of the cost functional PDF is analyzed. (paper)

Availability note (English)

Available from http://dx.doi.org/10.1088/1742-5468/2012/08/P08007

Additional details

Publishing Information

Journal Title
Journal of Statistical Mechanics
Journal Volume
2012
Journal Issue
08
Journal Page Range
[16 p.]
ISSN
1742-5468

INIS

Country of Publication
United Kingdom
Country of Input or Organization
International Atomic Energy Agency (IAEA)
INIS RN
46007613
Subject category
S71: CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS;
Descriptors DEI
ASYMPTOTIC SOLUTIONS; CONTROL; DISTRIBUTION FUNCTIONS; EXPECTATION VALUE; LIMITING VALUES; MATRICES; OPTIMIZATION; PROBABILITY; SCALARS; STABILITY; STOCHASTIC PROCESSES
Descriptors DEC
FUNCTIONS; MATHEMATICAL SOLUTIONS