Informatics and Applications
2025, Volume 19, Issue 4, pp 65-71
OPTIMIZATION ACCORDING TO THE QUANTILE CRITERION OF THE TEST TAKER POSITION STRATEGY IN THE DYNAMIC MODEL OF PASSING THE TIME-LIMITED TEST
- S. V. Ivanov
- Ya. G. Martyushova
- A. V. Naumov
- A. E. Stepanov
Abstract
The problem of building optimal program and positional strategy in dynamic model of passing time- limited test is considered. The tester sequentially solves the test tasks, gaining a certain number of points for each task in case of the correct solution. The correctness of the test of each task is modeled by a random variable with a Bernoulli distribution. The time spent on solving each task is also considered to be random. The positional strategy is a function of the number of points scored after solving the next task and the total time spent on solving previous test tasks. The function takes the value one if the tester solves the next task and zero if misses. The criterion is the number of points scored for the test, the excess of which, while simultaneously fulfilling the limit on the test execution time, is guaranteed with a predetermined level of confidence which acts as a task parameter. To solve the problems under consideration, the equivalence property is used between the problem with the quantile criterion and the problem of maximizing the corresponding probability function. After that, a modification of the algorithm for solving a similar problem with a probabilistic quality criterion proposed earlier by the authors is used.
[+] References (23)
- Rasch, G. 1980. Probabilistic models for some intelligence and attainment tests. Chicago, IL: University of Chicago Press. 199 p.
- Van der Linden, W.J., D.J. Scrams, and D. L. Schnipke. 1999. Using response-time constraints to control for differential speededness in computerized adaptive testing. Appl. Psych. Meas. 23(3):195-210. doi: 10.1177/01466219922031329.
- Kuravsky, L. S., P. A. Marmalyuk, V. I. Alkhimov, and G. A. Yuryev. 2013. Novyy podkhod k postroeniyu intellektual'nykh i kompetentnostnykh testov [A new approach to constructing intellectual and competence-based tests]. Modelirovanie i analiz dannykh [Modelling and Data Analysis] 1:4-28. EDN: PYOMRR.
- Kuravsky, L. S., A. A. Margolis, P.A. Marmalyuk, A. S. Panfilova, G. A. Yuryev, and P. N. Dumin. 2016. A probabilistic model of adaptive training. Applied Mathematical Sciences 10(48):2369-2380. doi: 10.12988/ams.2016.65168.
- Naumov, A. V., and Ya. G. Martyushova. 2019. Adaptatsiya sistemy distantsionnogo obucheniya na osnove statisticheskoy obrabotki rezul'tatov raboty pol'zovateley [Distance learning system adaptation based on statistical processing of the results of users activities]. Trudy MAI [Trudy MAI] 109:21.13 p. doi: 10.34759/trd-2019-109-21.EDN: DTEXUO.
- Bosov, A. V., Ya. G. Martyushova, A.V. Naumov, and A. P. Sapunova. 2020. Bayesovskiy podkhod k postroeniyu individual'noy traektorii pol'zovatelya v sisteme distantsionnogo obucheniya [Bayesian approach to the construction of an individual user trajectory in the system
of distance learning]. Informatika i ee Primeneniya - Inform. Appl. 14(3):86-93. doi: 10.14357/19922264200313. EDN: WAKFJR.
- Bosov, A. V. 2022. Primenenie samoorganizuyushchikhsya neyronnykh setey k protsessu formirovaniya individual'noy traektorii obucheniya [Application of selforganizing neural networks to the process of forming an individual learning path]. Informatika i ee Primeneniya - Inform. Appl. 16(3):7-15. doi: 10.14357/19922264220302. EDN: HJQANN.
- Bosov, A. V., and A. V. Ivanov. 2022. Tekhnologiya klassifikatsii tipov kontenta elektronnogo uchebnika [Technology for classification of content types of e-textbooks]. Informatika iee Primeneniya - Inform. Appl. 16(4):63-72. doi: 10.14357/19922264220410. EDN: YERCNH.
- Bosov, A. V., and A. V. Ivanov. 2023. Tekhnologiya mnogofaktornoy klassifikatsii matematicheskogo kontenta elektronnoy sistemy obucheniya [Multifactor classification technology of mathematical content of e-learning system]. Informatika i ee Primeneniya - Inform. Appl. 17(4):32-41. doi: 10.14357/19922264230405. EDN: LISHHZ.
- Naumov, A. V., A. S. Dzhumurat, and A. O. Inozemtsev. 2014. Sistema distantsionnogo obucheniya matematicheskim distsiplinam CLASS.NET [Distance learning system for mathematical disciplines CLASS.NET]. Vestnik komp'yuternykh i informatsionnykh tekhnologiy [Herald of Computer and Information Technologies] 10:36-44. doi: 10.14489/vkit.2014.010.pp.036-044. EDN: SQIRWX.
- SDO MAI CLASS.NET [Distance learning system MAI CLASS.NET]. Available at: https://distance.kaf804.ru (accessed November 28, 2025).
- Martyushova, Ya.G., T.A. Mineyeva, and A. V. Naumov.
2023. Metody klassifikatsii pol’zovateley SDO v modeli postroeniya ikh individual'noy traektorii [Methods of classifying the distance learning system users in the model of constructing their personalized learning strategies]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 33(1):68-77. doi: 10.14357/08696527230107. EDN: FHLWMC.
- Bosov, A.V., G.A. Mkhitaryan, A. V. Naumov, and A. P. Sapunova. 2019. Ispol'zovanie modeli gamma- raspredeleniya v zadache formirovaniya ogranichennogo po vremeni testa v sisteme distantsionnogo obucheniya [Using the model of gamma distribution in the problem of forming a time-limited test in a distance learning system]. Informatika i ee Primeneniya - Inform. Appl. 13(4):11-17. doi: 10.14357/19922264190402. EDN: XUBLZX.
- Naumov, A. V., G. A. Mkhitaryan, and E. E. Cherygova. 2019. Stokhasticheskaya postanovka zadachi formirovaniya testa zadannogo urovnya slozhnosti s minimizatsiey kvantili vremeni vypolneniya [Stochastic statement of the problem of generating tests with defined complexity with the minimization of quantile of test passing time]. Vestnik komp'yuternykh i informatsionnykh tekhnologiy [Herald of Computer and Information Technologies] 2:37-46. doi: 10.14489/vkit.2019.02.pp.037- 046. EDN: TGXYNG.
- Xiao, J., and O. Bulut. 2022. Item selection with collaborative filtering in On-the-fly multistage adaptive testing. Appl. Psych. Meas. 46(8):690-704. doi: 10.1177/0146621622112408.
- Naumov, A. V., A. E. Stepanov, and A. E. Ustinov. 2024. On the problem of maximizing the probability of successful passing of a time-limited test. Automat. Rem. Contr. 85(1):60-67. doi: 10.1134/s0005117924010053. EDN: XKGXWC.
- Martyushova, Ya. G., A. V. Naumov, and A. E. Stepanov. 2024. Optimizatsiya prokhozhdeniya ogranichennogo po vremeni testa po kvantil'nomu kriteriyu [Optimization of the strategy of passing the time-limited test according to the quantile criterion]. Informatika i ee Primeneniya - Inform. Appl. 18(4):44-51. doi: 10.14357/19922264240406. EDN: WVKTIF.
- Stepanov, A. E. 2025. Maksimizatsiya srednego chisla nabrannykh ballov v ogranichennom po vremeni teste [Maximizing the average score in a timed test]. Modeli- rovanie i analiz dannykh [Modeling and Data Analysis] 15(1):158-167. doi: 10.17759/mda.2025150109. EDN: EJSAOU.
- Ivanov, S. V., and A. E. Stepanov. 2025. Optimization by a probabilistic criterion in a dynamic test passing model. Automat. Rem. Contr. 85(6):589-597. doi: 10.31857/ S0005117925060076.
- Rosenblatt-Roth, M. 1965. Quantiles and medians. Ann. Math. Stat. 36(3):921-925. doi: 10.1214/aoms/ 1177700064.
- Santoso, T, S. Ahmed, M. Goetschalckx, and A. Shapiro. 2005. A stochastic programming approach for supply chain network design under uncertainty. Eur. J. Oper. Res. 167(1):96-115. doi: 10.1016/j.ejor.2004.01.046.
- Kuravsky, L. S., and S. I. Popkov. 2018. Forecasting macro parameters representing the behavior of an applied multi-agent system. Int. J. Modeling Simulation Scientific Computing 9(6):1850052. 15 p. doi: 10.1142/S1793962318500526.
- Ignatov, A. N. 2020. On the construction of positional control in a multistep portfolio optimization problem with probabilistic criterion. Automat. Rem. Contr. 81(12):2181-2193. doi: 10.1134/S0005117920120036. EDN: MSUFBA.
[+] About this article
Title
OPTIMIZATION ACCORDING TO THE QUANTILE CRITERION OF THE TEST TAKER POSITION STRATEGY IN THE DYNAMIC MODEL OF PASSING THE TIME-LIMITED TEST
Journal
Informatics and Applications
2025, Volume 19, Issue 4, pp 65-71
Cover Date
2025-30-12
DOI
10.14357/19922264250407
Print ISSN
1992-2264
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
time-limited test; dynamic model; positional strategy; quantile criterion
Authors
S. V. Ivanov  , Ya. G. Martyushova , A. V. Naumov , and A. E. Stepanov
Author Affiliations
Moscow Aviation Institute (National Research University), 4 Volokolamskoe Shosse, Moscow 125933, Russian Federation
|