Systems and Means of Informatics
2026, Volume 36, Issue 1, pp 22-44
WAVELET NEURAL NETWORKS BAYES SYNTHESIS OF MULTIDIMENSIONAL NONLINEAR STOCHASTIC SYSTEMS
- I. N. Sinitsyn
- V. I. Sinitsyn
- E. R. Korepanov
- T. D. Konashenkova
Abstract
New methodological tools of optimal synthesis of multidimensional linear stochastic system (StS) on Bayes criterion (BC) are based on quantitative estimate of output stochastic process (StP). Nonlinear StS is described by Pugachev equation for input and output StP. Input StP contains useful signal and random additive multidimensional normal noise with zero mathematical expectation and known matrix of covariance functions. Random noise does not depend upon vector of random parameters of useful signal. Distribution of random vector parameters is known. After a short survey, the model of BC optimal estimate of output StP is constructed on the basis of wavelet canonical expansion (CE) of random noise and wavelet CE of input StP. To find unknown parameters in optimal output StP, an estimate architecture of multilayer wavelet neural networks (WNN) is developed. The WNN training algorithm for inverse error prevalence by the method of steepest descent is used. Formulae for mathematical expectation, second initial probabilistic moment, and error covariance matrix of BC optimal estimate of output StP are obtained. Numerical experiments with cubic two-dimensional StS illustrate WNN preference with wavelet CE.
[+] References (18)
- Pugachev, V. S. 1965. Theory of random functions and its application to control problems. Oxford: Pergamon Press. 852 p.
- Sinitsyn, I. N. 2023. Kanonicheskie predstavleniya sluchaynykh funktsiy. Teoriya i primeneniya [Canonical expansions of random functions. Theory and applications]. 2nd ed. Moscow: TORUS PRESS. 816 p.
- Sinitsyn, I.N., V. I. Sinitsyn, E.R. Korepanov, and T.D. Konashenkova. 2024. Beyesov sintez mnogomernoy stokhasticheskoy sistemy vysokoy dostupnosti metodom veyvlet kanonicheskikh razlozheniy [Bayesian synthesis of multidimensional stochastic system with high availability by the method of wavelet canonical expansions]. Siste- my vysokoy dostupnosti [Highly Availability Systems] 20(1):55-66. doi: 10.18127/ j20729472-202401-06. EDN: OMIDZW.
- Sinitsyn, I.N., V. I. Sinitsyn, E.R. Korepanov, and T.D. Konashenkova. 2024. Neyrosetevoy sintez optimal'noy lineynoy stokhasticheskoy sistemy po kriteriyu minimuma srednekvadratichnoy oshibki [Neural network synthesis of an optimal linear stochastic system according to the criterion of minimum mean square error]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 34(3):87-108. doi: 10.14357/08696527240307. EDN: FVQWBN.
- Sinitsyn, I.N., V. I. Sinitsyn, E.R. Korepanov, and T.D. Konashenkova. 2025. Neyrosetevoy bayesovskiy sintez mnogomernoy lineynoy stokhasticheskoy sistemy [Neural networks Bayes synthesis of multidimensional linear stochastic system]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 35(3):33-53. doi: 10.14357/08696527250303. EDN: SUNQAL.
- Daubechies, I. 1992. Ten lectures on wavelets. Philadelphia, PA: Society for Industrial and Applied Mathematics. 352 p.
- Dotsenko, A.V. 2020. Avtomaticheskiy sintez nepreryvnoy dinamicheskoy sistemy stabilizatsii na osnove iskusstvennykh neyronnykh setey [Automatic synthesis of a continuous dynamic stabilization system based on artificial neural networks]. Vestnik Moskovskogo gosudarstvennogo tekhnicheskogo universiteta im. N. E. Baumana. Ser. Priborostroenie [Herald of the Bauman Moscow State Technical University. Ser. Instrument Engineering] 3(132):66{83. doi: 10.18698/0236-3933-2020-3-66-83. EDN: ADEEYU.
- Li, S., H. Huang, and W. Lu. 2021. A neural networks based method for multivariate time-series forecasting. IEEE Access 9:63915{63924. doi: 10.1109/access. 2021.3075063. EDN: IKAPFN.
- Musavi, N., D. Sun, S. Mitra, G. E. Dullerud, and S. Shakkottai. 2023. Hy- HooVer: Verification and parameter synthesis in stochastic systems with hybrid state space using optimistic optimization. IEEE Open J. Control Systems 2:263{276. doi: 10.1109/ojcsys.2023.3299152. EDN: NXBJJR.
- Chernyshev, L. S. 2023. Identifikatsiya neyrosetevoy modeli tekhnicheskoy sistemy ili protsessa s tsel'yu sinteza optimal'nogo upravleniya [Identification of a neural network model of a technical system or process for the purpose of synthesis of optimal control]. Tekhnologii elektromagnitnoy sovmestimosti [Electromagnetic Compatibility Technologies] 2(85):74^8. EDN: UVOUMIK
- Chen, Z., and W. Ma. 2024. A Bayesian approach to data-driven multi-stage stochastic optimization. J. Global Optim. 90:40^428. doi: 10.1007/s10898-024-01410-3. EDN: WPGMYA.
- Biryukov, I. D. 2024. Sovmestnyy kvazioptimal'nyy algoritm obrabotki radiosignalov istochnikov radioizlucheniya aviatsionnym sredstvom radiotekhnicheskogo nablyudeniya [Joint quasi-optimal algorithm for processing radio signals from radio emission sources by an aviation electronic intelligence tool]. Vestnik RAEN [Bulletin of the Russian Academy of Natural Sciences] 24(3):48{58. doi: 10.52531/1682-1696-2024- 24-3-48-58. EDN: FVQSXJ.
- Zhu, B., H. R. Karimi, L. Zhang, and X. Zhao. 2025. Neural network- based adaptive reinforcement learning for optimized backstepping tracking control of nonlinear systems with input delay. Appl. Intell. 55(2): 129. 16 p. doi: 10.1007/s10489-024-05932-x. EDN: NFOEVA.
- Sinitsyn, I.N., V.I. Sinitsyn, E. R. Korepanov, and T.D. Konashenkova. 2024. Modelirovanie nestatsionarnogo stokhasticheskogo protsessa posredstvom ego kanonicheskogo razlozheniya na osnove veyvlet-neyronnoy seti [Nonstationary stochastic process modeling by canonical expansion and wavelet neutral network]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 34(2):21{39. doi:
10.14357/08696527240202. EDN: YFHFIN.
- Sinitsyn, I.N., V.I. Sinitsyn, E. R. Korepanov, and T.D. Konashenkova. 2025. Algoritm modelirovaniya vektornogo stokhasticheskogo protsessa posredstvom ego kanonicheskogo razlozheniya na osnove mnogosloynoy veyvlet-neyronnoy seti [Modeling algorithms for vector stochastic process by canonical expansions based on multilayer wavelet neural network]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 35(2):17{30. doi: 10.14357/08696527250202. EDN: TFDTXJ.
- Haykin, S. 1999. Neural networks. A comprehensive foundation. 2nded. Prentice-Hall of India Pvt. Ltd. 842 p.
- Terekhov, S.A. 2001. Veyvlety i neyronnye seti [Wavelets and neural networks]. Nauchnaya sessiya MIFI: III Vseros. nauchn.-tekhn. konf. "Neyroinformatika: lektsii po neyroinformatike [Scientific session MEPhI: 3rd All-Russian Scientific and Technical Conference "Neuroinformatics": Lectures on neuroinformatics]. Moscow: MIFI. 142{ 181.
- Veitch, D. 2005. Wavelet neural networks and their application in the study of dynamical system. Networks 1(8):313{320.
[+] About this article
Title
WAVELET NEURAL NETWORKS BAYES SYNTHESIS OF MULTIDIMENSIONAL NONLINEAR STOCHASTIC SYSTEMS
Journal
Systems and Means of Informatics
Volume 36, Issue 1, pp 22-44
Cover Date
2026-05-05
DOI
10.14357/08696527260102
Print ISSN
0869-6527
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
Bayes criterion; canonical expansion; modeling; loss function; optimal estimate; stochastic process; stochastic system; wavelet; wavelet-neural network
Authors
I. N. Sinitsyn  , V. I. Sinitsyn  , E. R. Korepanov  , and T. D. Konashenkova
Author Affiliations
 Federal Research Center "Computer Science and Control", Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
|