Experience in Using Assessment Tools and e-Learning Quality Management Practices (Case Study of Tomsk State University)

The aim of the study was to analyze the use of assessment tools and the experience of managing the quality of education in the electronic information and educational environment of the university on the example of Tomsk State University in the context of the changes that occurred during the pandemic COVID-19. The relevance of the study is due to the fact that the system of higher education in Russia is developing in the context of a permanent change in the requirements for it, internal and external challenges, which determines the need for a consistent response while maintaining the fundamental foundations of this social institution.

Materials and methods. The authors relied on a systematic approach to create a holistic review of the available tools for assessing and managing the quality of e-learning at Tomsk State University, an activity approach to identify the transformation of the range of tools used, depending on the increase in the subjectivity of participants in the educational process. The following methods were used in the work: analysis of pedagogical, scientific, technical and methodological literature on the research problem, systematization, generalization, analysis, observation, statistical methods for processing results.

Results. The study summarizes and describes the experience of Tomsk State University in using assessment tools and quality management practices of e-learning at the university before the pandemic COVID-19, which made it possible to effectively switch to a forced remote format of student learning. These are the analysis of educational data obtained based on the learning management system MOODLE, the assessment of the quality of e-learning using feedback, and the expertise of e-learning courses. Also study systematized and described new tools for analyzing, evaluating, monitoring, improving and predicting the quality of e-learning, introduced at the university in the context of the pandemic COVID-19, which together made it possible to lay the foundation for the transition of the university to a blended learning model in the post-pandemic period. These were activity monitoring of the subjects of the educational process with the ranking of the measured index, changes in personnel policy, digital diploma supplement etc. The developed tools make it possible to manage the quality of e-learning based on data, and reach the management of the quality of education as a whole through the “balancing” of the structure and content of all components of the educational program.

Conclusion. The system for the implementation of e-learning of Tomsk State University ensured the harmonious integration of educational activities using distance learning technologies into the experience of educational interaction between professors and students. It remains possible to maintain the stability and quality of lectures and practical classes, and often enrich them through the capabilities of digital tools. Further expansion of the set of applied tools for assessing and ensuring the quality of e-learning in the university made it possible to organize a transition to a distance learning format, and created the basis for meaningful consolidation of a mixed learning model at the university in the post-pandemic period.

1. Gafurov I.R., Ibragimov G.I., Kalimullin A.M., Alishev T. B. Transformation of education in highereducation during a pandemic: pain points. Vyssheye obrazovaniye v Rossii = Higher education in Russia. 2020; 10: 101–112. (In Russ.)

2. Demina O.A., Teplenova I.A. On the transformation of the methodological thinking of university teachers. Vyssheye obrazovaniye v Rossii = Higher education in Russia. 2020; 7: 156–167. (In Russ.)

3. Drugova Ye.A., Veledinskaya S.V., Zhuravleva I.I., Dorofeyeva M.Yu. Use of pedagogical design tools to ensure the quality of blended learning. Seriya «Metodicheskiye rekomendatsii po ispol’zovaniyu novykh instrumentov upravleniya kachestvom obrazovaniya na osnove opyta vedushchikh rossiyskikh universitetov» = Series “Methodological recommendations on the use of new tools for managing the quality of education based on experience leading Russian universities. Tomsk: Tomsk State University; 2021. 64 p. (In Russ.)

4. Sukhanova Ye.A., Frumin I.D. Kachestvo obrazovaniya v rossiyskikh universitetakh: chto my ponyali v pandemiyu: analiticheskiy doklad = The quality of education in Russian universities: what we understood during the pandemic: an analytical report. Tomsk: Tomsk State University; 2021. 46 p. (In Russ.)

5. Romero C., Ventura S. Educational Data Mining: A Review of the State of the Art. IEEE Transactions on Systems Man and Cybernetics. Part C (Applications and Reviews). 2010; 40; 6: 601-618. DOI: 10.1109/TSMCC.2010.2053532.

6. Belonozhko P.P., Karpenko A.P., Khramov D.A. Analysis of educational data: directions and prospects of application [Internet]. Vestnik yevraziyskoy nauki = Bulletin of Eurasian Science. 2017; 4(41). Available from: https://cyberleninka.ru/article/n/analiz-obrazovatelnyh-dannyhnapravleniya-i-perspektivy-primeneniya. (cited 05.10.2021). (In Russ.)

7. Fiofanova O.A. Analysis of the current state of research in the field of education management based on data. Tsennosti i smysly = Values and meanings. 2020; 1: 71-83. (In Russ.)

8. Balakin M.A. Designing a modern digital environment for managing basic educational programs at a university. ANI: pedagogika i psikhologiya = ANI: Pedagogy and Psychology. 2020; 2(31): 31–34. (In Russ.)

9. Zemtsov D.I., Nagapetyan A.R., Yas’kov I.O., Tkachenko I.V., Bondar’ T.N., Kokina U.D., Galitskiy V.D., Gorshkova V.A. Tsifrovaya transformation and infrastructure of complex communication formats in educational and managerial activities at the university. Seriya «Metodicheskiye rekomendatsii po ispol’zovaniyu novykh instrumentov upravleniya kachestvom obrazovaniya na osnove opyta vedushchikh rossiyskikh universitetov». Dal’nevostochnyy federal’nyy universitet = Series «Methodological recommendations for the use of new tools for managing the quality of education based on the experience of leading Russian universities.» Far Eastern Federal University. Tomsk: Tomsk State University; 2021. 24 p. (In Russ.)

10. Yel’tsov A.V., Yel’tsova L.F. On the implementation of some didactic principles of teaching in the electronic information and educational environment of the university. Lichnost’ v menyayushchemsya mire: zdorov’ye, adaptatsiya, razvitiye = Personality in a changing world: health, adaptation, development. 2021; 3(34): 249–257. (In Russ.)

11. Mozhayeva G.V. Comprehensive measures for the introduction of e-learning in a classical university. XX Mezhdunarodnaya nauchnometodicheskaya konferentsiya «Sovremennoye obrazovaniye: soderzhaniye, tekhnologii, kachestvo» = XX International Scientific and Methodological Conference «Modern Education: Content, Technology, Quality». (April 23, 2014,

12. St. Petersburg). Saint Petersburg: St. Petersburg Electrotechnical University «LETI» named after. V.I. Ulyanova (Lenina); 2014: 11–13. (In Russ.)

13. Babanskaya O.M., Mozhayeva G.V., Stepanenko A.A., Feshchenko A.V. Organization of e-learning monitoring system in LMS MOODLE. Otkrytoye i distantsionnoye obrazovaniye = Open and distance education. 2016; 3(63): 27–35. (In Russ.)

14. Babanskaya O.M., Mozhayeva G.V., Stepanenko A.A., Feshchenko A.V. Evaluation of the quality of e-learning support through measuring the activity of university teachers. Sovremennoye obrazovaniye: soderzhaniye, tekhnologii, kachestvo: XXII Mezhdunarodnaya nauchno-metodicheskaya konferentsiya. T. 1 = Modern education: content, technology, quality: XXII International Scientific and methodical conference. T. 1. Saint Petersburg: Saint Petersburg State University «LETI»; 2016: 46–48. (In Russ.)

15. Babanskaya O.M., Bal’ V.Yu. Principles and stages of examination of electronic training courses (experience of Tomsk State University). Materialy XXV Mezhdunarodnoy konferentsii «Primeneniye novykh tekhnologiy v obrazovanii» = Proceedings of the XXV International Conference «Application of new technologies in education». (June 25-26, 2014 Troitsk - Moscow). Troitsk- Moscow: Trovant; 2014: 476–477. (In Russ.)

16. Babanskaya O.M., Mozhayeva G.V., Feshchenko A.V. Examination of electronic and online courses: the experience of Tomsk State University. Luchshiye praktiki elektronnogo obucheniya: materialy II metodicheskoy konferentsii = Best practices of e-learning: materials of the II methodological conference. Tomsk: Tomsk State University; 2016: 5–8. (In Russ.)

17. Goryunova Ye.S. Tools for analyzing the educational process in the Moodle distance learning system. EdCrunch. Materialy mezhdunarodnoy konferentsii po novym obrazovatel’nym tekhnologiyam = EdCrunch. Proceedings of the international conference on new educational technologies (May 29-31, 2019, Tomsk). Tomsk: Tomsk State University; 2019: 85–94. (In Russ.)

18. Ivanova A.S., Pestun Ya.Ye., Stepanenko A.A., Feshchenko A.V. Methods of transferring academic grade for discipline into the level of competence formation of a university graduate. Aktual’nyye problemy nauki i obrazovaniya v usloviyakh sovremennykh vyzovov / Sbornik materialov IV Mezhdunarodnoy nauchnoprakticheskoy konferentsii = Actual problems of science and education in the conditions of modern challenges / Collection materials of the IV International Scientific and Practical Conference (September 10, 2021, Moscow). Moscow: IROK LLC; 2021: 86-93. (In Russ.)

19. Alenicheva T.S., Kurshakova N.B., Mamayeva N.A. Formation of the structure of factors influencing the quality of management of the training of students in educational institutions of higher education. Vestnik SibADI = Bulletin of SibADI. 2017; 6(58): 155–163. (In Russ.)

20. Babanskaya O.M., Mozhayeva G.V., Feshchenko A.V., Serbin V.A. A systematic approach to the organization of e-learning in a classical university. Otkrytoye obrazovaniye = Open Education. 2015; 2(109): 63–69. (In Russ.)

21. Korovko A.V. Description of the practice of education quality management in the context of the COVID-19 pandemic based on the experience of the National Research University Higher School of Economics. Seriya «Praktiki upravleniya kachestvom obrazovaniya na osnove opyta vedushchikh rossiyskikh universitetov». Natsional’nyy issledovatel’skiy universitet «Vysshaya shkola ekonomiki» = Series “Education quality management practices based on the experience of leading Russian universities”. National Research University Higher School of Economics. Tomsk: Tomsk State University; 2021. 26 p. (In Russ.)

22. Solovov A.V., Men’shikova A.A. Models of design and functioning of digital educational environments. Vyssheye obrazovaniye v Rossii = Higher education in Russia. 2021; 1: 144–155. (In Russ.)

23. Trubcheninova I.A., Gazizov T.R. The practice of implementing the quality assessment of master’s programs. Vestnik TGPU = Vestnik TSPU. 2018; 8(197): 177-184. (In Russ.)

24.