ASSESSING ORACY SKILLS IN ONLINE COURSES
DOI:
https://doi.org/10.31494/2412-9208-2023-1-1-305-316Keywords:
oracy skills, assessing oracy, assessing online, distance learning, communication.Abstract
This academic article explores the intricacies of assessing oracy skills online within the context of online courses. While online learning has been growing in popularity, with many educational institutions transitioning to this mode of delivery, there remains a lack of empirical insight into designing online courses that account for the right assessment. The study seeks to address this gap by investigating the challenges and strategies involved in assessing oracy skills online. The article highlights the multifaceted nature of oracy assessment, which involves assessing oral language and communicative competence. Additionally, assessing oracy skills requires flexibility, as students mature and move from one age period to another. The challenges of online assessment are also discussed, including academic dishonesty, which can hinder fair assessment. Plagiarism, identity verification, and cheating are all identified as key challenges in online assessment. Moreover, students may experience a lack of motivation, insufficient and unrealistic information, and inadequate communication with their instructors as additional barriers in online learning. In response to these challenges, the article outlines various strategies and technologies that can be employed to assess oracy skills online. These include using formative online tests, which provide quick feedback and help build confidence and maintain practice, as well as summative tests that stem from taking formative tests. Additionally, the article suggests that educators should focus on positive student perceptions and outcomes in online learning to develop better practices. Overall, this article highlights the importance of understanding the intricacies of assessing oracy skills in online courses and provides insights into the challenges and strategies involved in this process. By taking into account the various factors that can impact online assessment, educators can develop more effective and engaging online courses that promote student success.
References
Abdel Latif, M. M. (2021). Coping with covid-19-related online English teaching challenges: Teacher educators’ suggestions. ELT Journal, 76(1), 20–33. https://doi.org/10.1093/elt/ccab074 [in English].
Al-Adwan, A. S., Albelbisi, N. A., Hujran, O., Al-Rahmi, W. M., & Alkhalifah, A. (2021). Developing a holistic success model for sustainable e-learning: A structural equation modeling approach. Sustainability, 13(16), 9453. https://doi.org/10.3390/su13169453 [in English].
Bailey, A. L. (2010). Assessment in schools – oracy. International Encyclopedia of Education, 285–292. https://doi.org/10.1016/b978-0-08-044894-7.00327-4 [in English].
Barthakur, A., Kovanovic, V., Joksimovic, S., Siemens, G., Richey, M., & Dawson, S. (2021). Assessing program-level learning strategies in moocs. Computers in Human Behavior, 117, 106674. https://doi.org/10.1016/j.chb.2020.106674 [in English].
Bdair, I. A. (2021). Nursing students' and faculty members' perspectives about online learning during COVID-19 pandemic: A qualitative study. Teaching and Learning in Nursing, 16(3), 220–226. https://doi.org/10.1016/j.teln.2021.02.008 [in English].
Benson, A. D. (2003). Assessing participant learning in online environments. New Directions for Adult and Continuing Education, 2003(100), 69–78. https://doi.org/10.1002/ace.120 [in English].
Boitshwarelo, B., Reedy, A. K., & Billany, T. (2017). Envisioning the use of online tests in assessing twenty-First Century learning: A literature review. Research and Practice in Technology Enhanced Learning, 12(1). https://doi.org/10.1186/s41039-017-0055-7 [in English].
Consiglio d'Europa. (2020). Common european framework of reference for languages: Learning, teaching, Assessment: Companion volume / conseil de l'europe (editor). Council of Europe. [in English].
De-Marcos, L., Domínguez, A., Saenz-de-Navarrete, J., & Pagés, C. (2014). An empirical study comparing gamification and social networking on e-learning. Computers & Education, 75, 82–91. https://doi.org/10.1016/j.compedu.2014.01.012 [in English].
Dridi, M. A., Radhakrishnan, D., Moser-Mercer, B., & DeBoer, J. (2020). Challenges of blended learning in refugee camps: When internet connectivity fails, human connection succeeds. The International Review of Research in Open and Distributed Learning, 21(3). https://doi.org/10.19173/irrodl.v21i3.4770 [in English].
Dumford, A. D., & Miller, A. L. (2018). Online learning in higher education: Exploring advantages and disadvantages for engagement. Journal of Computing in Higher Education, 30(3), 452–465. https://doi.org/10.1007/s12528-018-9179-z [in English].
Ferst, P. (1999). Orienting oracy: Empowerment or enslavement. Journal of Further and Higher Education, 23(2), 257–267. https://doi.org/10.1080/0309877990230209 [in English].
Fuller, C. J. (2001). Orality, literacy and memorization: Priestly education in contemporary South India. Modern Asian Studies, 35(1), 1–31. https://doi.org/10.1017/s0026749x01003717 [in English].
Goodsett, M. (2020). Assessing the potential for critical thinking instruction in information literacy online learning objects using best practices. Communications in Information Literacy, 14(2). https://doi.org/10.15760/comminfolit.2020.14.2.4 [in English].
Guerrero-Roldán, A.-E., & Noguera, I. (2018). A model for aligning assessment with competences and learning activities in online courses. The Internet and Higher Education, 38, 36–46. https://doi.org/10.1016/j.iheduc.2018.04.005 [in English].
Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement. Proceedings of the First ACM Conference on Learning @ Scale Conference. https://doi.org/10.1145/2556325.2566239 [in English].
Hamid, S., Waycott, J., Kurnia, S., & Chang, S. (2015). Understanding students' perceptions of the benefits of online social networking use for teaching and learning. The Internet and Higher Education, 26, 1–9. https://doi.org/10.1016/j.iheduc.2015.02.004 [in English].
Harzing, A. W. (2007) Publish or Perish. Available from : https://harzing.com/resources/publish-or-perish [in English].
Healey-Benson, F. (2021). Authentic vlogs. Designing Courses with Digital Technologies, 118–122. https://doi.org/10.4324/9781003144175-25 [in English].
Hendrix, E. (2016). Assessing student stress in clinical laboratory science programs: Online versus face-to-face. Clinical Laboratory Science, 29(2), 99–100. [in English].
Hill, B. (2021). It's good to talk: Speaking up for Oracy in the management classroom. The International Journal of Management Education, 19(2), 100462. https://doi.org/10.1016/j.ijme.2021.100462 [in English].
Hughes, L. J., Mitchell, M. L., & Johnston, A. N. B. (2019). Just how bad does it have to be? industry and academic assessors' experiences of failing to fail – a descriptive study. Nurse Education Today, 76, 206–215. https://doi.org/10.1016/j.nedt.2019.02.011 [in English].
Kaldahl, A.-G. (2019). Assessing oracy: Chasing the teachers’ unspoken oracy construct across disciplines in the landscape between policy and freedom. L1 Educational Studies in Language and Literature, 19, Running Issue (Running Issue), 1–24. https://doi.org/10.17239/l1esll-2019.19.03.02 [in English].
Kereluik, K., Mishra, P., Fahnoe, C., & Terry, L. (2013). What knowledge is of most worth. Journal of Digital Learning in Teacher Education, 29(4), 127–140. https://doi.org/10.1080/21532974.2013.10784716 [in English].
Ladyshewsky, R. K. (2014). Post-graduate student performance in ‘supervised in-class’ vs. ‘unsupervised online’ multiple choice tests: Implications for cheating and test security. Assessment & Evaluation in Higher Education, 40(7), 883–897. https://doi.org/10.1080/02602938.2014.956683 [in English].
Lazarevic, B., & Bentz, D. (2020). Student perception of stress in online and face-to-face learning: The exploration of stress determinants. American Journal of Distance Education, 35(1), 2–15. https://doi.org/10.1080/08923647.2020.1748491 [in English].
Lim, D. H., & Morris, M. L. (2005). The effect of flexible learning delivery format on online learners' learning, application, and instructional perception. Journal of Educational Technology Systems, 33(4), 385–397. https://doi.org/10.2190/dgpy-qygn-qgj3-6d6j [in English].
Liu, Z.-Y., Lomovtseva, N., & Korobeynikova, E. (2020). Online learning platforms: Reconstructing modern higher education. International Journal of Emerging Technologies in Learning (IJET), 15(13), 4. https://doi.org/10.3991/ijet.v15i13.14645 [in English].
Long, E. (2021). An experiment in how to teach strategies for effective classroom interaction. Meaningful Teaching Interaction at the Internationalised University, 184–195. https://doi.org/10.4324/9780429329692-15 [in English].
Magal-Royo, T., Garcia Laborda, J., Mora Cantallops, M., & Sánchez Alonso, S. (2021). Alternative computer assisted communicative task-based language testing: New Communicational and interactive online skills. International Journal of Emerging Technologies in Learning (IJET), 16(19), 251. https://doi.org/10.3991/ijet.v16i19.26035 [in English].
Mercer, N., Warwick, P., & Ahmed, A. (2017). An oracy assessment toolkit: Linking research and development in the assessment of students' spoken language skills at age 11-12. Learning and Instruction, 48, 51–60. https://doi.org/10.1016/j.learninstruc.2016.10.005 [in English].
Moussa, N. (2021). Assessing the higher education settings after the transition to online learning: Exploring teaching, assessments, and students’ academic success. International Journal of Learning, Teaching and Educational Research, 20(12), 159–173. https://doi.org/10.26803/ijlter.20.12.10 [in English].
Oliver, R., Haig, Y., & Rochecouste, J. (2005). Communicative competence in Oral Language Assessment. Language and Education, 19(3), 212–222. https://doi.org/10.1080/09500780508668675 [in English].
Olt, M. R. (2002). Ethics and Distance Education: Strategies for Minimizing Academic Dishonesty in Online Assessment. Online Journal of Distance Learning Administration, (3)5. [in English].
Osborne, D. M., Byrne, J. H., Massey, D. L., & Johnston, A. N. B. (2018). Use of online asynchronous discussion boards to engage students, enhance critical thinking, and Foster staff-student/student-student collaboration: A mixed method study. Nurse Education Today, 70, 40–46. https://doi.org/10.1016/j.nedt.2018.08.014 [in English].
Parkes, R. S. V., & Barrs, V. R. (2021). Interaction identified as both a challenge and a benefit in a rapid switch to online teaching during the COVID-19 pandemic. Journal of Veterinary Medical Education, 48(6), 629–635. https://doi.org/10.3138/jvme-2020-0063 [in English].
Paulsrud, B. A., Gray, D., & Dodou, K. (2021). Video assignments. Designing Courses with Digital Technologies, 107–111. https://doi.org/10.4324/9781003144175-23 [in English].
Pollard-Durodola, S. D., Mathes, P. G., Vaughn, S., Cardenas-Hagan, E., & Linan-Thompson, S. (2006). The role of Oracy in developing comprehension in Spanish-speaking English language learners. Topics in Language Disorders, 26(4), 365–384. https://doi.org/10.1097/00011363-200610000-00008 [in English].
Reusch, C. F. (2021). Emerging Researchers' Conference ECER 2021. Orality or Oracy on the Agenda – How do Policy Documents Frame Oral Competencies? Copenhagen, Netherlands; Aarhus University/University College. [in English].
Rovai, A. P. (2000). Online and traditional assessments: What is the difference? The Internet and Higher Education, 3(3), 141–151. https://doi.org/10.1016/s1096-7516(01)00028-8 [in English].
Sautter, E. P., & Zúñiga, M. A. (2018). The video cover letter: Embedded assessment of oral communication skills. Quality Assurance in Education, 26(4), 423–429. https://doi.org/10.1108/qae-04-2018-0034 [in English].
Shuey, S. (2002). Assessing Online Learning in Higher Education. Journal of Instruction Delivery Systems, 16(2), 13–18. [in English].
Soffer, O. (2016). The oral paradigm and Snapchat. Social Media + Society, 2(3), 205630511666630. https://doi.org/10.1177/2056305116666306 [in English].
Vanslambrouck, S., Zhu, C., Lombaerts, K., Philipsen, B., & Tondeur, J. (2018). Students' motivation and subjective task value of participating in online and blended learning environments. The Internet and Higher Education, 36, 33–40. https://doi.org/10.1016/j.iheduc.2017.09.002 [in English].
Wilkinson, A. (1965). The concept of Oracy*. English in Education, 2(A2), 3–5. https://doi.org/10.1111/j.1754-8845.1965.tb01326.x [in English].
Xiong, Y., & Suen, H. K. (2018). Assessment approaches in massive open online courses: Possibilities, challenges and future directions. International Review of Education, 64(2), 241–263. https://doi.org/10.1007/s11159-018-9710-5 [in English].
