A study of the effectiveness to use electronic educational resources with web analytics tools (on the example of a departmental University of the Ministry of Emergency Situations of Russia)

Purpose of research. The purpose of this work is to study the effectiveness of the use of electronic educational resources and their demand for students. The availability of digital technologies and readiness of students and lecturers to study in the electronic educational environment ensure the active development of this form of educational process organization. To assess the effectiveness and demand for electronic educational resources, data on the parameters of operation and user interaction with educational material are required.

Materials and methods. To obtain data on the operating parameters and users’ work in the electronic educational environment, it is proposed to use a multi-level automated system for training, monitoring and analysis of theoretical knowledge – the Fire Test program, which is designed to organize and implement training in higher education programs of the specialty 20.05.01 – Fire Protection, 40.05.03 – Forensic Examination, the direction of training 20.03.01 – Technosphere Safety and the educational program of secondary vocational education 20.02.04 – Fire Protection. The Fire Test program is available on the Internet and allows you to conduct independent testing on specialties, disciplines, subjects of disciplines, as well as to carry out self-monitoring and knowledge control by lecturers online. As a tool for evaluating the effectiveness and relevance of the Fire Test program, it is proposed to use the web analytics service – Yandex.Metrica. To monitor the Fire Test program, we have selected key parameters that characterize the number of users and their activity in the electronic educational environment, which include demographic parameters, parameters of activity and loyalty of trainees, and technology parameters.

Results. Based on the results of monitoring demographic parameters, which included the age of the audience during the study period of 1 month, the Fire Test program received an average of 27 visits from lecturers and 15 visits from trainees. Visitors from the number of students were 87%, from the number of Faculty Members – 13%. Monitoring user activity by time spent in the Fire Test program showed that students spent an average of 8 minutes 57 seconds on the site, and lecturers – 10 minutes 32 seconds. The largest number of visits of trainees was made during classes from 8-00 to 14-00 (55%), during the period outside of training sessions and self-training from 17-00 to 22-00 (23%), there was a uniform appeal of trainees to the Fire Test program. According to the monitoring of the loyalty parameter, during the study period, 12% of users accessed the site only 1 time, the largest number of users (48%) worked in the Fire Test program from 16 to 127 times, and more than 128 times 13% of users accessed the site. Monitoring of the technology parameter showed that smartphones are used as the main device for working in the Fire Test program, the share of which is 88.2%. The main operating systems used on smartphones are iOS (51%) and Google Android (37%), while the most popular browsers are Mobile Safari (44%).

Conclusion. The results of the study allow us to conclude about the effectiveness and relevance of the electronic educational environment implemented by the Fire Test program among the trainees of Ivanovo Fire and Rescue Academy of the State Fire Service of the Ministry of Emergency Situations of Russia, as evidenced by their loyalty and activity in remote operation with the educational material.

1. GfK research: Internet penetration in Russia [Internet]. Issledovatel’skaya kompaniya «GfK Group» = Research company «GfK Group». Available from: https://www.gfk.com/ru/insaity/press-release/issledovanie-gfk-proniknovenieinterneta-v-rossii/. (cited 09.04.2020). (In Russ.)

2. Krasnova G.A., Nukhuly A., Teslenko V.A. The main trends in the development of the market of electronic education in the world. Vestnik Moskovskogo gorodskogo pedagogicheskogo universiteta. Seriya: Informatika i informatizatsiya obrazovaniya = Bulletin of Moscow City Pedagogical University. Series: Informatics and Informatization of Education. 2017; 3 (41): 93-98. (In Russ.)

3. Beloglazov A.A., Beloglazova L.B., Beloglazova I.A., Trubacheyev Ye.V., Mal’tsev O.L., Kletskin A.A., Pecherskiy D.K., Blokhin M.R. M-learning technologies in higher education: problems and prospects. Vestnik Rossiyskogo universiteta druzhby narodov. Seriya: Informatizatsiya obrazovaniya = Bulletin of the Peoples’ Friendship University of Russia. Series: Informatization of Education. 2018; 15; 4: 432-442. (In Russ.)

4. Zhilina A.I., Chepurenko G.P., Yur’yeva D.V. Mobile learning as a pedagogical innovation in the knowledge management system. Vestnik Leningradskogo gosudarstvennogo universiteta im. A.S. Pushkina = Bulletin of the Leningrad State University. A.S. Pushkin. 2019; 2: 132-146. (In Russ.)

5. Kasatkina N.N. Study of the readiness of university students to mobile learning. Yaroslavskiy pedagogicheskiy vestnik = Yaroslavl Pedagogical Bulletin. 2017; 6: 133-138. (In Russ.)

6. Motovits T.G., Pen’kova A.S., Prokhorova Ye.D. Current trends in the development of the education system. Problemy vysshego obrazovaniya = Problems of Higher Education. 2019; 1: 45-47. (In Russ.)

7. Al-Emran M., Elsherif H.M., Shaalan K. Investigating attitudes towards the use of mobile learning in higher education. Computers in Human Behavior. 2016; 56: 93-102. DOI: 10.1016/j.chb.2015.11.033.

8. Navarro C.X., Molina A.I., Redondo M.A., Juárez-Ramírez R. Framework to Evaluate M-Learning Systems: A Technological and Pedagogical Approach.Revista Iberoamericana de Tecnologias Del Aprendizaje. 2016. 11 (1): 33-40. DOI: 10.1109/RITA.2016.2518459.

9. Ngampornchai A., & Adams J. Students’ acceptance and readiness for E-learning in Northeastern Thailand. International Journal of Educational Technology in Higher Education. 2016; 13 (1). DOI: 10.1186/s41239-016-0034-x.

10. Shorfuzzaman M., Alhussein M. Modeling Learners’ Readiness to Adopt Mobile Learning: A Perspective from a GCC Higher Education Institution.Mobile Information Systems. 2016. DOI:10.1155/2016/6982824.

11. Luchenetskaya-Burdina I.YU., Fedotova A.A. Investigating attitudes towards the use of mobile learning in higher education. Yaroslavskiy pedagogicheskiy vestnik = Computers in Human Behavior. 2017; 3: 131-135. (In Russ.)

12. Leont’yeva I.A., Rebrina F.G. Framework to Evaluate M-Learning Systems: A Technological and Pedagogical Approach. Vestnik Chelyabinskogo gosudarstvennogo pedagogicheskogo universiteta = Revista Iberoamericana de Tecnologias Del Aprendizaje. 2018; 3: 114-124. (In Russ.)

13. Belous I. A., Chupalov A. YA. Comparative analysis of modern distance learning systems. Vestnik Moskovskogo gorodskogo pedagogicheskogo universiteta. Seriya: Informatika i informatizatsiya obrazovaniya = Bulletin of Moscow City Pedagogical University. Series: Informatics and Informatization of Education. 2019; 3 (49): 85-95. (In Russ.)

14. Koval’chuk S.S., Garkusha N.A., Medyankina Ye.N., Mukhina YU.N Online education: from the experience of foreign and Russian universities. Vyssheye obrazovaniye segodnya = Higher education today. 2020; 1: 31-37.

15. Zhadayev D.S. Distance learning systems: a review of software platforms. Informatizatsiya obrazovaniya i nauki = Informatization of education and science. 2019; 3 (43): 15-21. (In Russ.)

16. Shaverskaya O.N. Use of Google applications in the work of a teacher. Vestnik Moskovskogo gorodskogo pedagogicheskogo universiteta. Seriya: informatika i informatizatsiya obrazovaniya = Bulletin of the Moscow City Pedagogical University. Series: informatics and informatization of education. 2016; 4: 44-49. (In Russ.)

17. Kamalidinova E.R., Sardak L.V. Features of the preparation of electronic educational resources for use in the implementation of mobile learning. Pedagogicheskoye obrazovaniye v Rossii = Pedagogical education in Russia. 2017; 6: 53-59. (In Russ.)

18. Anokhin A.A. Development of electronic information resources of the library of a higher education institution in assessing their demand by users. Vesník Belaruskaga dzyarzhaŭnaga uníversíteta kul’tury í mastatstvaŭ = Vesnik Belaruskaga dzyarzhaўnaga universiteta culture i mastastva. 2017; 1 (27): 146-155. (In Russ.)

19. Kudinova G.F., Kapisheva T.YU., Popova Ye.V., Kurbangaleyeva G.M. Monitoring of Russian-language educational Internet resources related to the study and teaching of the Russian language. Vestnik Chelyabinskogo gosudarstvennogo pedagogicheskogo universiteta = Bulletin of the Chelyabinsk State Pedagogical University. 2018; 3: 102-113. (In Russ.)

20. Kutsenko S.M., Kosulin V.V. Electronic educational resources as an educational tool. Vestnik Kazanskogo gosudarstvennogo energeticheskogo universiteta = Bulletin of Kazan State Power Engineering University. 2017; 4 (36): 127-134. (In Russ.)

21. Savkina A.V., Nushtayeva A.V., Savinov I.A., Vechkanova YU.S. Statistical studies of the quality of electronic educational resources. Obrazovatel’nyye tekhnologii i obshchestvo = Educational Technologies and Society. 2019; 22; 3: 81-93. (In Russ.)

22. Kann S.K. Methodological approaches to assessing the attendance of library sites. Trudy GPNTB SO RAN = Transactions of SPSL SB RAS. 2018; 13-2: 252-263. (In Russ.)

23. Shevchenko D.A. Digital marketing in the field of education. Prakticheskiy marketing = Practical marketing. 2018; 1 (251): 3-11. (In Russ.)

24. Nikitina Ye.E. Analysis of a university site as an element of digital education: the search for ways to improve. Vestnik Tverskogo gosudarstvennogo universiteta. Seriya: Ekonomika i upravleniye = Bulletin of Tver State University. Series: Economics and Management. 2019; 3: 103-109. (In Russ.)

25. Malyy I.A., Bulgakov V.V., Akimov M.I., Kosterin I. V A multi-level automated system for teaching, monitoring and analyzing the level of theoretical knowledge of students in higher education institutions of the Ministry of Emergencies of Russia «(FIRETEST). Svidetel’stvo o registratsii programmy dlya EVM RU 2017613078 = Certificate of registration of a computer program RU 2017613078, March 10, 2017. Application No. 2017610210 of January 10, 2017. (In Russ.)

26. Bulgakov V.V. Improving the quality of theoretical training of cadets using information and communication technologies. Otkrytoye obrazovaniye = Open Education. 2019; 23; 5: 44-53. (In Russ.)

27. Bulgakov V.V. Structural and methodological model of a computer program for controlling the theoretical knowledge of cadets. Otkrytoye obrazovaniye = Open Education. 2018; 22; 3: 4-13. (In Russ.)