The Use of Artificial Intelligence Tools in Scientific Documentation Expertise
Abstract
The article examines the potential applications of artificial intelligence (AI) technologies for enhancing the efficiency of expert review of goal-setting documents in research and development projects. The study analyzes existing methods of expert assessment and identifies their shortcomings, including high labor intensity, subjectivity, and significant time requirements. The authors propose an architecture for a Digital Intelligent Expert System (DIES) capable of automating key stages of the expert review process, including expert selection, document analysis, and conclusion formulation. Particular attention is given to the selection of AI methods, such as machine learning, natural language processing, and hybrid approaches, as well as their integration into existing expert review processes. The article is addressed to specialists in science management, experts, and developers of digital solutions.
About the Authors
A. I. Grishin
Russian State University for the Humanities (RSUH); Bauman Moscow State Technical University (MSTU)
Russian Federation
Russian Federation
Aleksey I. Grishin - Candidate of Economic Sciences (Ph.D. in Economics), Associate Professor of the Department of Integrated Communications and Advertising, RSUH; Associate Professor of the Department IBM2 «Economics and Production Management», Bauman MSTU.
125047, Moscow, Miusskaya Square, building 6, section 6
E. A. Kosareva
SBI «MosTransProject»
Russian Federation
Russian Federation
Elena A. Kosareva - Candidate of Economic Sciences, (Ph.D. in Economics), Chief Research Fellow at the SBI «MosTransProject».
101000, Moscow, Potapovsky Lane, 3, building 1
References
1. Ukaz Prezidenta Rossiiskoi Federatsii ot 10.10.2019 № 490 «O razvitii iskusstvennogo intellekta v Rossiiskoi Federatsii» [Presidential Decree of the Russian Federation No. 490 dated 10.10.2019 «On the Development of Artificial Intelligence in the Russian Federation»]. Available at: http://www.kremlin.ru/acts/bank/44731 (accessed: 04.03.2025).
2. Aleksandrov V. A. Proektirovanie i upravlenie novovvedeniyami. Obzor informatsii [Design and Management of Innovations. Information Review]. Minsk: BelNIINTI. — 1988. — 124 p.
3. Belousov V. L. Menedzhment: praktika upravleniya nauchnymi issledovaniyami [Management: Practice of Research Management]. Moscow: FGU NII RINKTsE. — 2009. — 167 p.
4. Volkov V. I. Metodologiya kompleksnoi ekspertizy investitsionnykh programm i proektov. Monografiya, v 2 ch. [Methodology of Comprehensive Expert Assessment of Investment Programs and Projects. Monograph, in 2 parts]. Moscow: FGU NII RINKTsE. — 2004. — 368 p.
5. Gorfan K. L. Matematicheskoe modelirovanie i sovershenstvovanie planirovaniya nauchnykh issledovanii i razrabotok [Mathematical Modeling and Improvement of Research and Development Planning]. In: Upravlenie issledovaniyami, razrabotkami i vnedreniem novoi tekhniki [Management of Research, Development and Implementation of New Technology]. Moscow. — 1977. pp. 122-132.
6. Grishin V. I., Dzhafarov E. E. Iskusstvennyi intellekt v ekspertize rezul’tatov NIR [Artificial Intelligence in Expert Assessment of Research Results]. Moskovskii transport. Nauka i proektirovanie [Moscow Transport. Science and Design]. Moscow. — 2025, № 1 (1). — pp. 66-77.
7. Divueva N. A. Sovershenstvovanie organizatsii i provedeniya nauchnoi i nauchno-tekhnicheskoi ekspertizy na osnove avtomatizirovannykh sistem ekspertnogo otsenivaniya [Improving the Organization and Conduct of Scientific and Scientific-Technical Expert Assessment Based on Automated Expert Evaluation Systems]. Innovatika i ekspertiza [Innovation and Expert Assessment]. — 2011, № 2 (7) (accessed: 24.02.2025).
8. Dmitrenko I. P., Krasnova Yu. I. Ekspertiza NIR [Expert Assessment of Research Projects]. Aktual’nye problemy gumanitarnykh i estestvennykh nauk [Current Problems of Humanities and Natural Sciences]. Moscow. — 2015, № 10-1 (accessed: 27.02.2025).
9. Dutov A. V., Klochkov V. V. Model’ i kriterii prinyatiya reshenii v zadachakh optimal’nogo planirovaniya prikladnykh issledovanii v naukoemkoi promyshlennosti [Model and Decision-Making Criteria in Optimal Planning Problems of Applied Research in Knowledge-Intensive Industry]. Ekonomicheskii analiz: teoriya i praktika [Economic Analysis: Theory and Practice]. Moscow. — 2014, № 44 (395). — pp. 2-13.
10. Zaitsev B. F., Lapin B. A. Organizatsiya nauchno-tekhnicheskogo planirovaniya [Organization of Scientific and Technical Planning]. Moscow: Ekonomika. — 1970. — 207 p.
11. Iskusstvennyi intellekt (II) [Artificial Intelligence (AI)]. Available at: https://inlnk.ru/n0aX14 (accessed: 05.04.2025).
12. Kriterii konkursnogo otbora nauchnykh, nauchno-tekhnicheskikh programm i proektov, predstavlennykh na konkurs Rossiiskogo nauchnogo fonda [Criteria for Competitive Selection of Scientific and Scientific-Technical Programs and Projects Submitted to the Russian Science Foundation Competition]. Available at: http://www.rscf.ru/ (accessed: 20.02.2025).
13. Litvak B. G. Ekspertnye tekhnologii v upravlenii: uchebnoe posobie [Expert Technologies in Management: Textbook]. 2nd ed., revised and expanded. Moscow: Delo: Akad. nar. khoz-va pri Pravitel’stve Ros. Federatsii. — 2004. — 398 p.
14. Mitina O. V., Evdokimenko A. S. Metody analiza teksta: metodologicheskie osnovaniya i programmnaya realizatsiya [Text Analysis Methods: Methodological Foundations and Software Implementation]. Vestnik YuUrGU [Bulletin of South Ural State University]. — 2010, № 40. — pp. 29-38.
15. Polozhenie ob ekspertnykh sovetakh Rossiiskogo nauchnogo fonda [Regulations on Expert Councils of the Russian Science Foundation]. Available at: http://www.rscf.ru/ (accessed: 20.02.2025).
16. Ponomarev A. B., Pikuleva E.A. Metodologiya nauchnykh issledovanii: Uchebnoe posobie [Research Methodology: Textbook]. Perm: Izd-vo Perm. nats. issled. politekh. un-ta. — 2014. — 186 p.
17. Poryadok provedeniya ekspertizy nauchnykh, nauchno-tekhnicheskikh programm i proektov, predstavlennykh na konkurs Rossiiskogo nauchnogo fonda [Procedure for Expert Assessment of Scientific and Scientific-Technical Programs and Projects Submitted to the Russian Science Foundation Competition]. Available at: http://www.rscf.ru/ (accessed: 24.02.2025).
18. Rekomendatsii ekspertu Rossiiskogo nauchnogo fonda [Recommendations for Russian Science Foundation Experts]. Available at: http:// www.rscf.ru/ (accessed: 24.02.2025).
19. Troshin D. V. Metod otsenki rezul’tatov nauchno-issledovatel’skikh rabot [Method for Evaluating Research Results]. Ekonomicheskii analiz: teoriya i praktika: nauch. — prakt. i analit. zhurnal [Economic Analysis: Theory and Practice: Scientific-Practical and Analytical Journal]. — 2014, № 46, — pp. 50-59.
20. Tuzova S. Yu., Gorbunova I. Yu., Divnenko O. V., Kolyshkin V. A. O kriteriyakh ekspertnoi otsenki kachestva rezul’tatov proektov v ramkakh FTsP «Issledovaniya i razrabotki po prioritetnym napravleniyam razvitiya nauchno-tekhnicheskogo kompleksa Rossii na 2014-2020 gody» [On Criteria for Expert Quality Assessment of Project Results within the Federal Target Program «Research and Development in Priority Areas of Development of the Russian Scientific and Technical Complex for 2014-2020»]. Sovremennye innovatsii [Modern Innovations]. — 2017, № 1 (15) (accessed: 01.03.2025).
21. Sharabchiev Yu. T., Dudina T. V. Metodologiya ekspertizy planiruemykh i zavershennykh nauchno-issledovatel’skikh razrabotok [Methodology for Expert Assessment of Planned and Completed Research Developments]. Mezhdunarodnye obzory: klinicheskaya praktika i zdorov’e [International Reviews: Clinical Practice and Health]. — 2013, № 6 (6), — pp. 141-161.
22. Yudina N. P. Lektsiya «Kriterii rezul’tatov nauchnogo issledovaniya. Aktual’nost’ issledovaniya i ee argumenty» [Lecture «Criteria for Research Results. Research Relevance and Its Arguments»]. Available at: https://spravochnik.ru/lektoriy/kriterii-rezultatov-nauchnogo-issledovaniya-aktualnost-issledovaniya-i-ee-argumenty/ (accessed: 24.02.2025).
Review
For citations:
Grishin A.I., Kosareva E.A. The Use of Artificial Intelligence Tools in Scientific Documentation Expertise. Moscow Transport. Science and Designn. 2025;(2):88-97. (In Russ.)
Views:
6
Email this article 