Informatics and Applications
2020, Volume 14, Issue 2, pp 1925
STOCHASTIC DIFFERENTIAL SYSTEM OUTPUT CONTROL BY THE QUADRATIC CRITERION. V. CASE OF INCOMPLETE STATE INFORMATION
Abstract
A generalization of the optimal control problem for the Ito diffusion process and a linear controlled output with a quadratic quality criterion for the case of indirect observation of the state is considered. The available solution of the problem with full information is used to synthesize control from indirect observations based on the principle of separation. The ability to separate control and state filtering tasks is justified by the properties of the quadratic criterion used. Instead of solving the arising auxiliary problem of optimal filtering described by the general equations of nonlinear filtering based on innovation processes, it is proposed to use the estimate of the conditionally optimal filter of V. S. Pugachev. Thus, the suboptimal solution of the control problem under consideration is obtained as a result of the traditional approach to control synthesis in the problem with incomplete information, consisting in a formal replacement in solving the corresponding problem with complete information of the state variable by its estimate. Finally, a case of numerical implementation of the obtained suboptimal control is proposed. It is based on the method of computer simulation, using a common beam of simulated paths both for calculating the parameters of a conditionally optimal filter and for calculating the parameters in the original control problem.
[+] References (11)
 Bosov, A.V., and A.I. Stefanovich. 2018. Upravle nie vykhodom stokhasticheskoy differentsial'noy siste my po kvadratichnomu kriteriyu. I. Optimal'noe reshenie metodom dinamicheskogo programmirovaniya [Stochastic differential system output control by the quadratic criterion. I. Dynamic programming optimal solution]. Informatika i ee Primeneniya  Inform. Appl. 12(3):99106.
 Bosov, A.V., and A.I. Stefanovich. 2019. Upravlenie vykhodom stokhasticheskoy differentsial'noy sistemy po kvadratichnomu kriteriyu. II. Chislennoe reshenie urav neniy dinamicheskogo programmirovaniya [Stochastic differential system output control by the quadratic criterion. II. Dynamic programming equations numerical solution]. Informatika i ee Primeneniya  Inform. Appl. 13(1):915.
 Bosov, A.V., and A.I. Stefanovich. 2019. Upravlenie vykhodom stokhasticheskoy differentsial'noy sistemy po kvadratichnomu kriteriyu. III. Analiz svoystv opti mal'nogo upravleniya [Stochastic differential system output controlby the quadratic criterion. III. Optimal control properties analysis]. Informatika i ee Primeneniya  Inform. Appl. 13(3):4149.
 Bosov, A.V., and A.I. Stefanovich. 2020. Upravlenie vykhodom stokhasticheskoy differentsial'noy sistemy po
kvadratichnomu kriteriyu. IV. Al'ternativnoe chislennoe reshenie [Stochastic differential system output control by the quadratic criterion. IV. Alternative numerical decision]. Informatika i ee Primeneniya  Inform. Appl. 14(1):2430.
 Fleming, W H., and R. W. Rishel. 1975. Deterministic and stochastic optimal control. New York, NY: SpringerVerlag. 222 p.
 Gihman, 1.1., and A. V. Skorohod. 2012. The theory of stochastic processes. New York, NY: SpringerVerlag. Vol. 3. 388 p.
 0ksendal, B. 2003. Stochastic differential equations. An introduction with applications. New York, NY: Springer Verlag. 379 p.
 Pugachev, V. S., and I. N. Sinitsyn. 1987. Stochastic differential systems. Analysis and filtering. Chichester, NY: J. Wiley & Sons. 549 p.
 Davis, M. H.A. 1977. Linear estimation and stochastic control. London: Chapman and Hall. 224 p.
 Feldbaum, A. A. 1966. Osnovy teorii optimal'nykh av tomaticheskikh system [Foundations of theory of optimal automatic systems]. Moscow: Nauka. 624 p.
 Liptser, R. S., and A. N. Shiryaev. 2001. Statistics of random processes II. Applications. Berlin: SpringerVerlag. 402 p.
[+] About this article
Title
STOCHASTIC DIFFERENTIAL SYSTEM OUTPUT CONTROL BY THE QUADRATIC CRITERION. V. CASE OF INCOMPLETE STATE INFORMATION
Journal
Informatics and Applications
2020, Volume 14, Issue 2, pp 1925
Cover Date
20200630
DOI
10.14357/19922264200203
Print ISSN
19922264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
stochastic differential equation; stochastic differential system; optimal control; stochastic filtering; conditionallyoptimal filtering; computer simulations
Authors
A. V. Bosov
Author Affiliations
Institute of Informatics Problems, Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 442 Vavilov Str., Moscow 119333, Russian Federation
