Course on Educational Web-Content Accessibility: Analysis of Online Learning Results

Purpose of research. The paper deals with the analysis of the learning outcomes of non-degree students in the first online course in the Russian Federation on the development of accessible educational webcontent. Analysis of the problems of online education shows that open online courses are inaccessible for people with disabilities, education online platforms do not comply with the principles of accessibility, lecturers do not have experience in teaching methods of using distance learning technologies in e-learning for the people with disabilities, web developers have little knowledge of web accessibility guidelines and policies. Thus, the development of curricula and courses on the basics of web accessibility and universal design for e-learning stakeholders belongs to current didactic tasks.

Materials and methods. The study analyzed the learning outcomes in a free course “Web accessibility in e-learning” (Stepik platform) in the period from 10 February to 11 November 2020 (491 participants). Statistical data of Stepik used for analysis and included: date of enrollment in the course; the results of tasks’ passing and the content of the students’ answers; the results of each student’s progress in steps, modules and final testing; the number of views, correct and incorrect decisions for each step; indexes of complexity and discriminatory power (distinctiveness) of tasks for each step. Data processing (sorting, filtering and grouping by attributes, calculating weighing coefficients and mean values) and graphical presentation of the results are performed in Microsoft Excel®. The analysis of the starting survey results was carried out in the program IBM SPSS Statistics 23 by methods of descriptive statistics (construction of frequency tables and cross tables).

Results. Analysis of the course enrollment showed weak user activity. 212 (43.2%) enrolled students successfully completed the course. Most of the students missed the optional types of work. At the same time, on average, users have successfully completed the current and final testing. Difficulty value indexes (0.51 ± 0.18) and discriminatory power indexes (0.35 ± 0.17) of the tests indicate that the test tasks have a moderate level of complexity. A comparative analysis of the discriminative indexes for different types of tests showed that case-tests have a greater discriminative power (0.41 ± 0.15) than classical tests (0.26 ± 0.09) with similar difficulty value indexes. According to self-assessment data, students made significant progress in the formation of accessible educational web-content (by 55.2%), which is consistent with the data of an objective assessment of knowledge, skills and abilities during the final testing.

Conclusion. An analysis of the activity and learning outcomes in the course “Web accessibility in e-learning” showed that target category of students do not always realize the need for development of professional competencies to create accessible educational web-content. The biggest problems are associated with attracting the audience to the course and insufficient self-discipline due to the lack of motivation of students. Under these circumstances, an optional approach to learning the basics of web accessibility is not enough. Technologies for the development of accessible educational web-content should be taught as a compulsory subject at all stages of lifelong education for specialists involved in the organization of e-learning

1. The COVID-19 pandemic has changed education forever. This is how. [Internet]. 2020. Available from: www.weforum.org/agenda/2020/04/ coronavirus-education-global-covid19-online-digital-learning/. (cited 01.02.2021).

2. Deti s osobymi obrazovatel’nymi potrebnostyami = Children with special educational needs [Internet]. 2020. Available from: edu.gov.ru/activity/ main_activities/limited_health/. (cited 01.02.2021). (In Russ.)

3. Gokhberg L.M., Ozerova O.K., Sautina Ye.V., Shugal’ N. B. Obrazovaniye v tsifrakh: 2020: kratkiy statisticheskiy sbornik = Education in figures: 2020: a short statistical collection. Moscow: NRU HSE; 2020. [Internet]. Available from: https://www. Educational Environment education hse.ru/primarydata/oc2020. (cited 01.02.2021). (In Russ.)

4. Chislennost’ invalidov = The number of disabled people [Internet]. 2020. Available from: https://sfri.ru/analitika/chislennost/chislennost?territory=undefined. (cited 01.02.2021). (In Russ.)

5. Federal’nyy gosudarstvennyy obrazovatel’nyy standart vysshego obrazovaniya (3++) po napravleniyam bakalavriata = Federal state educational standard of higher education (3 ++) in the areas of bachelor’s degree [Internet]. 2020. Available from: http://fgosvo.ru/fgosvo/151/150/24. (cited 01.02.2021). (In Russ.)

6. Accessibility: Designing and teaching courses for all learners [Internet]. Available from: https:// learn.canvas.net/courses/1159. (cited 01.02.2021).

7. Black D.R., Weinberg L.A., Brodwin M.G. Universal design for instruction and learning: A pilot study of faculty instructional methods and attitudes related to students with disabilities in higher education. Exceptionality Education International. 2014; 24; 1: 48–64. DOI: 10.5206/eei.v24i1.7710.

8. Coursera Basics of inclusive design for online education [Internet]. 2020. Available from: https:// www.coursera.org/learn/inclusive-design. (cited 01.02.2021).

9. E-learning accessibility [Internet]. 2018. Available from: https://www.w3.org/WAI/RD/wiki/ E-learning_Accessibility. (cited 01.02.2021).

10. Roberts K.D., Park H.J., Brown S., Cook B. Universal design for instruction in postsecondary education: A systematic review of empirically based articles. Journal of Postsecondary Education and Disability. 2011; 24; 1: 5–15. Available from: http:// www.ahead-archive.org/uploads/publications/ JPED/jped_24_1/JPED %2024_1 %20FINAL %20 DOCUMENT.pdf. (cited 01.02.2021).

11. Schelly C.L., Davies S.L., Spooner C.L. Student perceptions of faculty implementation of universal design for learning. Journal of Postsecondary Education and Disability. 2011; 24; 1: 17–30. Available from: http://www.ahead-archive.org/uploads/ publications/JPED/jped_24_1/JPED %2024_1 %20 FINAL %20DOCUMENT.pdf. (cited 01.02.2021).

12. The UDL Guidelines [Internet]. 2018. Available from: http://udlguidelines.cast.org. (cited 01.02.2021).

13. Introduction to web accessibility [Internet]. 2019. https://www.w3.org/WAI/fundamentals/accessibility-intro/. (cited 01.02.2021).

14. Web Content Accessibility Guidelines (WCAG) 2.0. [Internet]. 2008. Available from: https:// www.w3.org/TR/WCAG20/. (cited 01.02.2021).

15. Web Content Accessibility Guidelines (WCAG) 2.1. [Internet]. 2018. Available from: https:// www.w3.org/TR/WCAG21/. (cited 01.02.2021).

16. Al-Mouh N., Al-Khalifa A., Al-Khalifa H. A First Look into MOOCs Accessibility: The Case of Coursera. K. Miesenberger et al. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science. 2014; 8547: 145–152. DOI: 10.1007/978-3-319-08596-8_22.

17. Ramírez-Vega A., Iniesto F., Rodrigo C. Raising Awareness of the Accessibility Challenges in Mathematics MOOCs. TEEM 2017 Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality, ACM, New York, NY, USA. 2017: 92. DOI: 10.1145/3144826.3145435.

18. Kosova Ye A., Izetova M.Yu. Availability of massive open online courses in mathematics for students with disabilities. Voprosy obrazovaniya = Education Issues. 2020; 1: 205-229. DOI: 10.17323/1814-9545-2020-1-205-229. (In Russ.)

19. Sanchez-Gordon S., Luján-Mora S. Implementing Accessibility in Massive Open Online Courses’ Platforms for Teaching, Learning and Collaborating at Large Scale. In Andreas Meier, Luis Terán (Eds.), eDemocracy & eGovernment: Stages of a Democratic Knowledge Society: Springer, 2019: 151-160.

20. Bohnsack M., Puhl S. Accessibility of MOOCs. K. Miesenberger et al. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science. 2014; 8547: 141–144. DOI: 10.1007/978-3-319-08596-8_21.

21. Martın J.L., Amado-Salvatierra H.R., Hilera J.R. MOOCs for All: Evaluating the Accessibility of Top MOOC Platforms. International Journal of Engineering Education. 2016; 32; 5–B: 2374–2383.

22. Iniesto F., Rodrigo C. Accessibility Assessment of MOOC Platforms in Spanish: UNED COMA, COLMENIA and MiriadaX. Proceedings of the IEEE International Symposium on Computers in Education (Logrono, Spain, November, 12–14, 2014). 2014: 169–172. DOI: 10.1109/ SIIE.2014.7017724.

23. Ferati M., Mripa N., Bunjaku R. Accessibility of MOOCs for Blind People in Developing Non-English Speaking Countries. Proceedings of the 8th International Conference Applied Human Factors and Ergonomics (AHFE) (Orlando, July 27–31, 2016). 2016; 500: 519–528. DOI: 10.1007/978-3-319-41962-6_46.

24. Akgül, Y. Accessibility Evaluation of MOOCs websites of Turkey. Journal of Life Economics. 2018; 5: 23–36. DOI: 10.15637/jlecon.259.

25. Kosova Ye. A. Motivation and readiness of teachers to use distance learning technologies in teaching students with disabilities. Informatika i obrazovaniye = Informatics and Education. 2020; 9: 43–52. DOI: 10.32517/0234-0453-2020-35-9- 43-52. (In Russ.)

26. Ferati M., Vogel B. Accessibility in Web Development Courses: A Case Study. Informatics. 2020; 7(1): 8. DOI: 10.3390/informatics7010008.

27. Kosova Ye. A. Veb-dostupnost’ v elektronnom obuchenii [Internet]. 2020. Available from: https://stepik.org/course/64025. (cited 01.02.2021).

28. Course Evaluation Form 2.0. [Internet]. Available from: https://www.surveymonkey.com/r/ VR9WVPT. (cited 01.02.2021).

29. Crocker L., Algina J. Introduction to Classical and Modern Test Theory. Harcourt, New York, 1986. 527 p.

30. Kelley T., Ebel R., Linacre J.M. Item Drimination indices. Rasch Measurement Transactions. 2002; 16(3): 883–884. [Internet]. Available from: https:// www.rasch.org/rmt/rmt163a.htm. (cited 01.02.2021).

31. Introduction to Web Accessibility. [Internet]. 2020. Available from: https://courses.edx. org/courses/course-v1:W3Cx+WAI0.1x+3T2019/ course/. (cited 01.02.2021).

32. Accessibility: Designing and Teaching Courses for All Learners (HE) [Internet]. 2019. Available from: https://www.canvas.net/browse/empirestate/ empirestate-buffalostate/courses/accessibility-designing-teaching. (cited 01.02.2021).

33. Implementing UDL on Canvas (K-12/ HE). [Internet]. 2019. Available from: https://www. canvas.net/browse/innospire/courses/implementing-udl-on-canvas. (cited 01.02.2021).

34. The Online Educator: People and Pedagogy [Internet]. 2020. Available from: https://www.futurelearn.com/courses/the-online-educator. (cited 01.02.2021).

35. Basics of Inclusive Design for Online Education. [Internet]. 2021. Available from: https:// www.coursera.org/learn/inclusive-design. (cited 01.02.2021).

36. An Introduction to Accessibility and Inclusive Design [Internet]. 2021. Available from: https://www.coursera.org/learn/accessibility. (cited 01.02.2021).

37. Web Accessibility [Internet]. 2021. Available from: https://www.udacity.com/course/web-accessibility--ud891. (cited 01.02.2021).

38. Kosova Ye.A. Normative grounds for ensuring the accessibility of e-learning for persons with disabilities in the Russian Federation. Nepreryvnoye obrazovaniye: XXI vek = Continuing education: XXI century. 2020: 2(30). DOI: 10.15393/ j5.art.2020.5692. (In Russ.)

39. Lee S., Lee J., Liu X., Bonk C., Magjuka R. A Review of Case-based Learning Practices in an Online MBA Program: A Program-level Case Study. Educational Technology & Society. 2009; 12: 178-190.

40. Abbakumov D., Desmet S., Van den Noortgate W. Measuring student’s proficiency in MOOCs: multiple attempts extensions for the Rasch model. Heliyon. 2018; 4: 12. e01003. DOI: 10.1016/j.heliyon.2018.e01003.

41. Bergner Y., Choi I., Castellano K. Item Response Models for Multiple Attempts With Incomplete Data. Journal of Educational Measurement. 2019; 56: 415-436. DOI: 10.1111/jedm.12214.

42. Boud D., Falchikov N. Introduction: Assessment for the longer term. In: Boud, D., Falchikov, N. (eds) Rethinking Assessment for Higher Education: Learning for the Longer Term. London: Routledge; 2007: 3–13. DOI: 10.4324/9780203964309.

43. Ventista O. Self-assessment in Massive Open Online Courses. E-Learning and Digital Media. 2018; 15(4): 165-175. DOI:10.1177/2042753018784950.

44. Baird J., Andrich D., Hopfenbeck T. Assessment and learning: Fields apart?. Assessment in Education: Principles, Policy & Practice. 2017; 24(3): 317–350. DOI: 10.1080/0969594X.2017.1319337.

45. Halamish V., Bjork R. When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier. Journal of Experimental Psychology: Learning, Memory, and Cognition. 2011; 37(4): 801–812. DOI: 10.1037/a0023219.

46. Jansen R.S., Van Leeuwen A., Janssen J., Conijn R., Kester L. Supporting learners’ self-regulated learning in Massive Open Online Courses. Computers & Education. 2020; 146. 103771. DOI: 10.1016/j.compedu.2019.103771.

47. Hizam M, Nasir M., Khalid M. Self-Regulated Learning In A Massive Open Online Course: A Review of Literature. European Journal of Interactive Multimedia and Education. 2020; 1. DOI: 10.30935/ejimed/8403.

48. Prikaz Mintruda Rossii ot 08.09.2015 №608n «Ob utverzhdenii professional’nogo standarta «Pedagog professional’nogo obucheniya, professional’nogo obrazovaniya i dopolnitel’nogo professional’nogo obrazovaniya»= Order of the Ministry of Labor of Russia dated 09/08/2015 No. 608n “On approval of the professional standard” Teacher of vocational training, vocational education and additional vocational education” [Internet]. 2015. Available from: http://fgosvo.ru/uploadfiles/profstandart/01.004. pdf. (cited 01.02.2021). (In Russ.)

49. Prikaz Mintruda Rossii ot 18.01.2017 №44n «Ob utverzhdenii professional’nogo standarta «Razrabotchik Web i mul’timediynykh prilozheniy» = Order of the Ministry of Labor of Russia dated January 18, 2017 No. 44n “On the approval of the professional standard” Developer of Web and multimedia applications “[Internet]. 2017. Available from: http://fgosvo.ru/uploadfiles/profstandart/06.035. pdf. (cited 01.02.2021). (In Russ.)