Informatics and Applications
2026, Volume 20, Issue 1, pp 2-11
MULTIPLICATIVE OUTPUT CONTROL UNDER A QUADRATIC CRITERION: DYNAMIC PROGRAMMING AND THE OPTIMAL SOLUTION
- A. V. Bosov
- I. V. Uryupin
Abstract
The paper addresses an optimal control problem for a quasi-linear output of a stochastic differential
system driven by an Ito diffusion process. In contrast to the traditional additive control formulation, the controlled
linear output is assumed to include multiplicative control resulting in a quasi-linear differential system with
feedback. The problem is formulated using a general quadratic performance criterion which defines control
objectives identical to those in the additive control model. This allows for a direct comparison of control strategies
as alternative architectural solutions within the same application context. The study focuses on two multiplicative
control configurations: one where the control acts as amultiplier of the system state, and another where itmultiplies
an uncontrolled disturbance. The third possible case — output-multiplicative control — leads to a bilinear system;
since its analysis requires a different methodological framework, it is excluded from this study. The solution is
derived using a dynamic programming approach. Similar to the additive control case, the Bellman function is
shown to take a quadratic form with respect to the output variable. However, in the state-multiplicative control
configuration, the solution — characterized by three coefficients of the Bellman function — is substantially more
complex. This complexity motivates the problem of synthesizing practically implementable approximations.While
the disturbance-multiplicative control case is considerably simpler, its practical relevance is found to be limited.
[+] References (27)
- Fleming, W H., and R. W. Rishel. 1975. Deterministic and stochastic optimal control. New York, NY: Springer-Verlag. 222 p. doi: 10.1007/978-1-4612-6380-7.
- Athans, M. 1971. Editorial on the LQG problem. IEEE T. Automat. Contr. 16(6):528-552. doi: 10.1109/ TAC.1971.1099845.
- Davis, M. H.A. 1977. Linear estimation and stochastic control. London: Chapman and Hall. 224 p.
- D'Alessandro, P., A. Isidori, and A. Ruberti. 1974. Realization and structure theory of bilinear dynamical systems. SIAMJ. Control 12(3):517-535. doi: 10.1137/0312040.
- Willsky, A. S., and S. I. Marcus. 1976. Analysis of bilinear noise models in circuits and devices. J. Frankl. Inst. 301(1-2):103-122. doi: 10.1016/0016-0032(76)90135-6.
- Bagchi, A., and T. Schilperoort. 1980. Optimal linear stochastic control for systems with multiplicative noise. IEEE T. Automat. Contr. 25(5):1005-1007. doi: 10.1109/TAC.1980.1102479.
- Boyd, S., L. El Ghaoui, E. Feron, and V. Balakrishnan. 1994. Linear matrix inequalities in system and control theory. SIAM studies in applied mathematics ser. Philadelphia, PA: SIAM. Vol. 15. 193 p.
- Pakshin, P. V 1994. Diskretnye sistemy so sluchaynymi parametrami i strukturoy [Discrete systems with random parameters and structure]. Moscow: Fizmatlit. 304 p. EDN: ULTSFL.
- Pardalos, P. M., and V.A. Yatsenko. 2010. Optimization and control of bilinear systems: Theory, algorithms, and applications. Springer optimization and its applications ser. New York, NY: Springer. Vol. 11. 370p. doi: 10.1007/978- 0-387-73669-3.
- Shaikin, M. E. 2009. Stochastic problems in
and Automat. Rem. Contr. 70(2):173-202. doi: 10.1134/S0005117909020015. EDN: LLTVED.
- Piechottka, U., and P. M. Frank. 1990. Controllability of bilinear systems - a survey and some new results. IFAC Proceedings Volumes 22(3):23-28. doi: 10.1016/S1474- 6670(17)53604-6.
- Ding, C. 2020. Survey on progress and prospect of sensor management. Systems Engineering Electronics 42(12):2761-2770. doi: 10.3969/j.issn.1001-506X.2020. 12.12.
- Kreucher, C., K. Kastella, and A. O. Hero. 2005. Sensor management using an active sensing approach. Signal Process. 85(3):607-624. doi: 10.1016/j.sigpro.2004.11.004.
- Hoffmann, C., and H. Werner. 2015. A survey of linear parameter-varying control applications validated by experiments or high-fidelity simulations. IEEE T. Contr. Syst. T. 23(2):416-433. doi: 10.1109/TCST.2014. 2327584.
- Zhang, H., L. Li, J.Xu, andM. Fu. 2015. Linear quadratic regulation and stabilization of discrete-time systems with delay and multiplicative noise. IEEE T. Automat. Contr. 60(10):2599-2613. doi: 10.1109/TAC.2015.2411911.
- Hu, T., and Z. Lin. 2001. Control systems with actuator saturation: Analysis and design. Boston, MA: Birkhauser. 392 p. doi: 10.1007/978-1-4612-0205-9.
- Lin, H., and P.J. Antsaklis. 2009. Stability and stabilizability of switched linear systems: A survey of recent results. IEEE T. Automat. Contr. 54(2):308-322. doi: 10.1109/TAC.2008.2012009.
- Bosov, A. V., and A. I. Stefanovich. 2018. Upravlenie vykhodom stokhasticheskoy differentsial'noy sistemy po kvadratichnomu kriteriyu. I. Optimal'noe reshenie metodom dinamicheskogo programmirovaniya [Stochastic differential system output control by the quadratic criterion. I. Dynamic programming and optimal solution]. Informatika i ee Primeneniya - Inform. Appl. 12(3):99- 106. doi: 10.14357/19922264180314. EDN: MAGBSH.
- Bosov, A. V. 2012. Zadachi analiza i optimizatsii dlya modeli pol'zovatel'skoy aktivnosti. Chast' 2. Optimizatsiya vnutrennikh resursov [Analysis and optimization problems for some users activity model. Part 2. Internal resources optimization]. Informatika i ee Primeneniya - Inform. Appl. 6(1): 19-26. EDN: OZHDPP
- Bosov, A. V. 2012. Zadachi analiza i optimizatsii dlya modeli pol'zovatel'skoy aktivnosti. Chast' 3. Optimizatsiya
vneshnikh resursov [Analysis and optimization problems for some users actitity model. Part 3. External resources optimization]. Informatika i ee Primeneniya - Inform. Appl. 6(2):14-21. EDN: OZIOKD.
- Bosov, A. V., and A. I. Stefanovich. 2019. Upravlenie vykhodom stokhasticheskoy differentsial'noy sistemy po kvadratichnomu kriteriyu. III. Analiz svoystv optimal'nogo upravleniya [Stochastic differential system output control by the quadratic criterion. III. Optimal control properties analysis]. Informatika i ee Primeneniya - Inform. Appl. 13(3):41-49. doi: 10.14357/19922264190307. EDN: KJDISR.
- Helmes, K., and R. Rishel. 1992. The solution of a partially observed stochastic optimal control problem in terms of predictedmiss. IEEET. Automat. Contr. 37(9): 1462-1464. doi: 10.1109/9.159594.
- Rishel, R. 1994. A strong separation principle for stochastic control systems driven by a hidden Markov model. SIAM J. Control Optim. 32(4):1008-1020. doi: 10.1137/S0363012992232233.
- Bosov, A. V. 2021. The problem of controlling the linear output of a nonlinear uncontrollable stochastic differential system by the square criterion. J. Comput. Sys. Sc. Int. 60(5):719-739. doi: 10.1134/S 1064230721040031. EDN: ESNCSX.
- Yong, J., and X. Y. Zhou. 1999. Stochastic controls: Hamiltonian systems and HJB equations. New York, NY: Springer. 439 p. doi: 10.1007/978-1-4612-1466-3.
- Fleming, W. H., and H. M. Soner. 2006. Controlled Markov processes and viscosity solutions. Stochastic modelling and applied probability ser. New York, NY: Springer. Vol. 25. 429 p. doi: 10.1007/0-387-31071-1.
- Athans, M., and P. L. Falb. 1966. Optimal control: An introduction to the theory and its applications. New York, NY: McGraw-Hill. 879 p.
[+] About this article
Title
MULTIPLICATIVE OUTPUT CONTROL UNDER A QUADRATIC CRITERION: DYNAMIC PROGRAMMING AND THE OPTIMAL SOLUTION
Journal
Informatics and Applications
2026, Volume 20, Issue 1, pp 2-11
Cover Date
2026-01-04
DOI
10.14357/19922264260101
Print ISSN
1992-2264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
stochastic differential equation; optimal control; quasi-linear systems; multiplicative control; dynamic programming; Bellman function; Riccati equation; linear parabolic equations
Authors
A. V. Bosov  and I. V. Uryupin
Author Affiliations
 Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
|