Systems and Means of Informatics
2022, Volume 32, Issue 2, pp 47-57
ON THE USE OF EXPERT METHODS IN EVALUATING EFFECTIVENESS AND QUALITY OF INFORMATION SYSTEMS
- A. A. Zatsarinny
- Yu. S. Ionenkov
Abstract
The article is devoted to the application of expert methods in assessing effectiveness and quality of information systems. The general issues of the application of expert assessments, including the conduct of the expert survey procedure and the establishment of consistency of expert opinions, are considered. Various approaches to determining the number of experts, including formulas for calculations, are presented and comparative calculations based on these formulas are carried out. A formalized approach to assessing the competence of experts is presented, including their scientific qualifications, reasonableness of assessments, and the degree of familiarity with the problem being evaluated.
[+] References (15)
- GOST 15467-79. 2009. Upravlenie kachestvom produktsii. Osnovnye ponyatiya. Ter- miny i opredeleniya [Product quality control. Basic concepts. Terms and definitions]. Moscow: Standardinform Publs. 21 p.
- GOST 34.003-90. 2005. Informatsionnayatekhnologiya. Avtomatizirovannye sistemy. Terminy i opredeleniya [Information technology. Set of standards for automated systems. Automated systems. Terms and definitions]. Moscow: Standardinform Publs. 14 p.
- Zatsarinnyy, A. A., Yu. S. Ionenkov, and A. P. Shabanov. 2013. K voprosu o sravnitel'noy otsenke effektivnosti situatsionnykh tsentrov [Regarding comparative evaluation of situational centers efficiency]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 23(2): 155-171.
- Zatsarinnyy, A. A., and Yu. S. Ionenkov. 2015. K voprosu otsenki effektivnosti avtomatizirovannykh sistem s ispol'zovaniem metoda analiza ierarkhiy [Regarding automated systems efficiency evaluation using analytic hierarchy process]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 25(3): 161-178.
- Zatsarinnyy, A. A., and Y. S. Ionenkov. 2016. Nekotorye aspekty otsenki effektivnosti avtomatizirovannykh informatsionnykh sistem na razlichnykh stadiyakh ikh zhiznennogo tsikla [On aspects of automated information system efficiency evaluation at different stages of lifecycle]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 26(3): 123-136.
- Zatsarinny, A. A., Yu. S. Ionenkov, and A. P. Suchkov. 2018. Nekotorye aspekty otsenki effektivnosti oblachnykh tekhnologiy [Some aspects of cloud computing efficiency estimation]. Sistemy i Sredstva Informatiki - Systems and Means of Informatics 28(3): 104-117.
- Zatsarinny, A. A., and Y. S. Ionenkov. 2019. Nekotorye metodicheskie aspekty vybora pokazateley effektivnosti informatsionnykh sistem [Some methodological aspects of the choice of performance indicators of information systems]. Sistemy vysokoy dostupnosti [Highly Available Systems] 15(4): 19-26.
- Okunev, Y. B., and V. G. Plotnikov. 1976. Printsipy sistemnogo podkhoda k proektirovaniyu v tekhnike svyazi [Systematic approach principles to design in communication technics]. Moscow: Svyaz'. 183 p.
- Kuzovkova, T.A., T.Yu. Salyutina, and O.I. Sharavova. 2019. Statistika infokommunikatsiy [Statistics of infocommunications]. Moscow: Goryachaya liniya-Telekom. 548 p.
- Semenov, S. S. 2015. Otsenka kachestva i tekhnicheskogo urovnya slozhnykh sistem: Praktika primeneniya metoda ekspertnykh otsenok [Assessment of the quality and technical level of complex systems: The practice of applying the method of expert assessments]. Moscow: LENAND. 352 p.
- Litvak, B. G. 1996. Ekspertnye otsenki i prinyatie resheniy [Expert assessments and decision-making]. Moscow: Patent. 298 p.
- Saati, T. 1993. Prinyatie resheniy. Metod analiza ierarkhiy [Decisionmaking. Analytic hierarchy process]. Moscow: Radio i svyaz'. 278 p.
- Bobrovnikov, G.N., and A.I. Klebanov. 1989. Kompleksnoe prognozirovanie sozdaniya novoy tekhniki [Comprehensive forecasting of the creation of new equipment]. Moscow: Ekonomika. 205 p.
- Chernysheva, T. Yu. 2009. Ierarkhicheskaya model' otsenki i otbora ekspertov [Hierarchical model of evaluation and selection of experts]. Doklady TUSUR [Proceedings of the TUSUR University] 1-1(19): 168-173.
- Marycheva, P. G. 2018. Metodika otsenki kompetentnosti ekspertov [The method of assessment the competence of experts]. Vestnik Samarskogo gosudarstevennogo tekh- nicheskogo universiteta. Ser. Tekhnicheskie nauki [Vestnik of Samara State Technical University. Technical sciences ser.] 4(60):29-40.
[+] About this article
Title
ON THE USE OF EXPERT METHODS IN EVALUATING EFFECTIVENESS AND QUALITY OF INFORMATION SYSTEMS
Journal
Systems and Means of Informatics
Volume 32, Issue 2, pp 47-57
Cover Date
2022-06-10
DOI
10.14357/08696527220205
Print ISSN
0869-6527
Publisher
Institute of Informatics Problems, Russian Academy of Sciences
Additional Links
Key words
expert methods; efficiency; quality; number of experts; qualification of experts; information system
Authors
A. A. Zatsarinny  and Yu. S. Ionenkov
Author Affiliations
Federal Research Center "Computer Science and Control", Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation
|