Diagnostics of the results of mastering competencies in the information environment for teaching IT students

Purpose of research. Diagnostics of learning results presented in a competency-based format is currently a necessary part of the educational process of universities. The purpose of the research is to develop and implement a convenient and technological way to diagnose the results of mastering competencies by IT students in the information learning environment. One of the most popular distance learning systems in Russian universities, Moodle, supplemented with proprietary software and third-party resources, is used as the implementation environment. The article presents the results of modeling and implementation of the proposed method for diagnosing the results of mastering the competencies of IT students.

Methods and materials. The authors propose an infological model of the process of preparing a bank of diagnostic tasks in a competence format. The necessity of decomposition of competence indicators into disciplinary components, the achievement of which can be diagnosed by known means of pedagogical measurements, is substantiated. The method of implementing the decomposition of competencies in the Moodle system using the Competence Framework, and the technology of preparing diagnostic tasks based on the principle of uniform coverage of all competence indicators by tasks are presented. A step-by-step algorithm for adjusting the bank of tasks is proposed. The algorithm is based on the analysis of the statistical characteristics of the results of completing tasks by students. A method for automatically tracking the mastering of competencies by students based on the results of performing diagnostic tasks in the Moodle system is described.

Results. The article presents an example of the implementation of the proposed method for diagnosing the results of mastering the competencies in the process of training bachelors in the direction “09.03.04 Software engineering”. The following are presented: the result of decomposition of indicators of achievement of one of the decomposition of competencies into disciplinary components. The general professional competencies into disciplinary components, results of the implementation of the proposed method at the Vologda the process of preparing tasks for diagnostics for each disciplinary State University when teaching students of the direction “Software component, disciplinary and interdisciplinary results of diagnosing Engineering” are presented. The results of modeling and implethe mastering of competencies obtained in the Moodle system. mentation of the process of diagnostics of the results of mastering The results of the experiment showed that the implementation of competencies can be adapted to the educational process for various the proposed method in the information educational environment areas of training and forms of education. The continuation of this requires certain time costs at the preparatory stage, but they pay study has good prospects for improving the quality of diagnostic off by improving the quality of diagnostic procedures and the procedures of the competence format and the effectiveness of the convenience of their implementation. educational process as a whole.

Conclusion. In the course of the study, a technological method for diagnosing the results of mastering the competencies by IT
students in the information learning environment was developed,
implemented and tested in practice. The method is based on the
decomposition of competencies into disciplinary components. The
results of the implementation of the proposed method at the Vologda
State University when teaching students of the direction “Software
Engineering” are presented. The results of modeling and implementation of the process of diagnostics of the results of mastering competencies can be adapted to the educational process for various areas of training and forms of education. The continuation of this study has good prospects for improving the quality of diagnostic
procedures of the competence format and the effectiveness of the
educational process as a whole.

1. References

2. Raykhlina A.V., Gromova M.V., Kolesov R.V. An integrated approach to the implementation of blended learning in higher education. Otkrytoye obrazovaniye = Open education. 2022; 26(4): 55-65. (In Russ.)

3. Dement’yeva A.S. The concept of blended learning, advantages and some difficulties in its implementation. Voprosy ustoychivogo razvitiya obshchestva = Issues of sustainable development of society. 2022; 3: 910–914. (In Russ.)

4. Tel’nov Yu.F., Lebedev S.A., Gasparian M.S. Designing the main professional educational programs in the direction of training «Applied Informatics» based on professional standards. V sbornike «Novyye informatsionnyye tekhnologii v obrazovanii: innovatsii v ekonomike i obrazovanii na baze tekhnologicheskikh resheniy 1S. Chast’ 1. Sbornik nauchnykh trudov 17-oy Mezhdunarodnoy nauchno-prakticheskoy konferentsii = In the collection «New information technologies in education: innovations in economics and education based on technological solutions 1C. Part 1. Collection of scientific papers of the 17th International Scientific and Practical Conference. 2017; 20-26. (In Russ.)

5. Gavrilov A.V., Kulikova S.V., Golkina G.Ye. Improving the level of training of IT-specialists based on the analysis of labor market requirements. Otkrytoye obrazovaniye = Open Education. 2019; 23(6): 30-40. (In Russ.)

6. Vasil’yeva Ye.V. Modeling the demand for the qualifications of IT industry personnel. Upravleniye = Management. 2017; 4: 34–39. (In Russ.)

7. Avanesov V.S. History of the pedagogical theory of measurements. Pedagogicheskiye Izmereniya = Pedagogical Measurements. 2012; 3: 3-26. (In Russ.)

8. Mayorov A.N. Teoriya i praktika sozdaniya testov dlya sistemy obrazovaniya = Theory and practice of creating tests for the education system. Moscow: Intellect Center; 2001. 296 p. (In Russ.)

9. Korzhik I.A., Protasova I.V., Tolstobrov A.P. Test system Moodle and the quality of test items. Sovremennyye informatsionnyye tekhnologii i IT-obrazovaniye. Sbornik izbrannykh trudov VII Mezhdunarodnoy nauchno-prakticheskoy konferentsii = Modern information technologies and IT education. Collection of selected works of the VII International Scientific and Practical Conference. Moscow: INTUIT.RU; 2012: 187-196. (In Russ.)

10. Bershadskaya M.D., Serova A.V. Universal’nyye kompetentsii: indikatory, opyt razrabotki i otsenivaniya = Universal competencies: indicators, development and evaluation experience [Internet]. Available from: https://knastu.ru/media/files/page_files/teachers/Bershadskaya_UK__indikatory_opyt_razrabot.tsenivaniya_Seminar_ AKUR_05.2018.pdf. (cited 24.06.2023). (In Russ.)

11. Vasil’kova N.A. Normative and methodological aspects of the formation of funds for appraisal funds in the FSES 3++ model in the direction of higher education. Sovremennaya vysshaya shkola: innovatsionnyy aspect = Modern Higher School: Innovative Aspect. 2019; 11; 2: 62-77. (In Russ.)

12. Kazakova Ye. I., Tarkhanova I. Yu. Evaluation of the universal competencies of students in the development of educational programs. Yaroslavskiy pedagogicheskiy vestnik = Yaroslavl Pedagogical Bulletin. 2018; 5: 127-135. (In Russ.)

13. Polyanskiy A.M., Smirnova Ye.A. Designing a discipline work program based on competency elements. Otkrytoye obrazovaniye = Open Education. 2018; 22(3): 35-51. (In Russ.)

14. Ovchinnikov A.A., Gitman M.B., Gitman Ye.K. Algorithm for creating an automated information system for evaluating the level of formation of a university student’s competencies. Izvestiya vuzov. Tekhnologiya tekstil’noy promyshlennosti = Technology of textile industry. 2018; 3: 300-304. (In Russ.)

15. Shaforostova Ye.N., Valova A.A. Designing a graduate’s competency model as a means of assessing the quality of education. Otkrytoye obrazovaniye = Open Education. 2019; 23(5): 54-63. (In Russ.)

16. Prikaz Minobrnauki RF «Ob utverzhdenii Poryadka organizatsii i osushchestvleniya obrazovatel’noy deyatel’nosti po obrazovatel’nym programmam vysshego obrazovaniya – programmam bakalavriata, programmam spetsialiteta, programmam magistratury» ot 19 dekabrya 2013 g. № 1367 = Order of the Ministry of Education and Science of the Russian Federation “On Approval of the Procedure for Organization and Implementation of Educational Activities in Educational Programs of Higher Education – Bachelor’s Programs, Specialist’s Programs, Master’s Programs” dated December 19, 2013 No. 1367. (In Russ.)

17. Otkrytaya obuchayushchaya platforma Moodle = Open learning platform Moodle [Internet]. Available from: https://moodle.org. (cited 24.06.2023). (In Russ.)

18. Andrianov I.A., Rzheutskaya S.Yu., Kharina M.V. Interdisciplinary distance workshop for IT students. Otkrytoye obrazovaniye = Open Education. 2021; 2: 41-50. (In Russ.) 18. Rzheutskaya S.Yu., Rzheutskiy A.V. Classification algorithm for training tasks in a remote programming workshop. Intellektual’noinformatsionnyye tekhnologii i intellektual’nyy biznes (INFOS-2019): materialy desyatoy mezhdunarodnoy nauchno-tekhnicheskoy konferentsii = Intelligent Information Technologies and Intelligent Business (INFOS-2019): materials of the tenth international scientific and technical conference. Vologda: VSU; 2019: 217-220. (In Russ.)

19. Anatoly Shvetsov, Svetlana Rzheutskaya, Anna Sergushicheva, Alexey Sukonschikov, Igor Andrianov, Dmitry Kochkin. The Architecture of Intelligent Agent-based Educational System for Training Students in a Technical University. V International Conference on Information Technologies in Engineering Education (Inforino). (14-17 April 2020, Moscow) = V International Conference on Information Technologies in Engineering Education (Inforino). (14-17 April 2020, Moscow). Moscow: Institute of Electrical and Electronics Engineers Inc; 2020: 5. (In Russ.)

20. Federal’nyy gosudarstvennyy obrazovatel’nyy standart vysshego obrazovaniya – bakalavriat po napravleniyu podgotovki 09.03.04. Programmnaya inzheneriya = Federal state educational standard of higher education - bachelor’s degree in the field of study 09.03.04. Software Engineering [Internet]. Rezhim dostupa: http://fgosvo.ru/uploadfiles/FGOS%20VO%203++/Bak/090304_B_3_17102017.pdf.