Changes in Assessment Modality in Saudi Higher Education: Lessons Learnt Post-COVID-19

Wessam Mohamed, Taghreed A Almuqayteeb

Abstract


This article examines the changes in academics' assessment practices, the contributing variables in response to the transition to the online modality during the pandemic, and the most important 21st-century skills that academic programs should assess post-COVID. The study used a descriptive methodology with both quantitative and qualitative analyses via survey-based research. A total of 225 faculty members from different academic clusters, of different educational levels, genders, and assessment-related work experiences completed the questionnaire. The findings of this research identified interesting shifts in the academics' assessment practices upon 100% transition to the online modality. Specifically, most of the academics modified their assessment plans by lowering the workload of assessment tasks while retaining the same assessment methods. Additionally, a higher weightage of marks was allocated to the use of alternative/ authentic assessment. There was a noticeable increase in the employment of online assessment methods such as examinations, oral exams, assignments, and participation. Furthermore, both the academic cluster and course type had impacts on the utilization of online assessment methods. Lastly, the study identified critical thinking and problem-solving skills, information and computer technology-related skills, and creativity as the top skills to be assessed post-COVID-19. By examining the academics' assessment practices in response to the complete transition to the online modality, this research contributes to the sustainability of best practices in online assessment modalities in higher education. Finally, this study provides recommendations for academics: collaborative assignments, valued as a high-impact assessment practice, should be used to embed and sustain learning. Additionally, academics should be encouraged to adopt authentic assessment methods for online assessment.

https://doi.org/10.26803/ijlter.22.9.24


Keywords


post-COVID-19; changes; assessment modality; quality; authentic; higher education

Full Text:

PDF

References


Abduh, M. (2021). Full-time online assessment during COVID-19 lockdown: EFL teachers' perceptions. Asian EFL Journal, 28(1.1), 26–46.

Akimov, A., & Malin, M. (2020). When old becomes new: A case study of oral examination as an online assessment tool. Assessment & Evaluation in Higher Education, 45(8), 1205–1221. https://doi.org/10.1080/02602938.2020.1730301

Almahasheer, M. , Al Rubaish, A., Alkadi, A., Abdellatif, M., Ravinayagam, V., Assaf, W., Alomair, N. (2022). Faculty readiness for online teaching at Imam Abdulrahman Bin Faisal University during the COVID-19 crisis: A cross-sectional study. F1000Research, 10(840), 840. https://doi.org/10.12688/f1000research.28173.1

Almossa, S. , & Alzahrani, S. (2022). Assessment practices in Saudi higher education during the COVID-19 pandemic. Humanities and Social Sciences Communications 9(5), 1-9. https://doi.org/10.1057/s41599-021-01025-z

Almuqayteeb, T., & Mohamed, W. (forthcoming). Online assessment practices during the COVID-19 pandemic: An analysis of Saudi faculty experiences.

Al-Samiri, R. (2021). English language teaching in Saudi Arabia in response to the COVID-19 pandemic: Challenges and positive outcomes. Arab World English Journal (AWEJ) Special Issue on COVID 19 Challenges, 1, 147–159. https://dx.doi.org/10.24093/awej/COVID.11

Bakay, M. (2022). 21st Century skills for higher education students in EU countries: Perception of academicians and HR managers. International Education Studies, 15(2), 14-24. https://doi.org/10.5539/ies.v15n2p14

Baxter, G., & Hainey, T. (2023). Remote learning in the context of COVID-19: Reviewing the effectiveness of synchronous online delivery. Journal of Research in Innovative Teaching & Learning, 1(1), 67–81. https://doi.org/10.1108/jrit-12-2021-0086

Burgess, S., & Sievertsen, H. (2020). Schools, skills, and learning: The impact of COVID-19 on education. VoxEu. org. https://cepr.org/voxeu/columns/schools-skills-and-learning-impact-covid-19-education

Byrne, C. (2022). What determines perceived graduate employability? Exploring the effects of personal characteristics, academic achievements and graduate skills in a survey experiment. Studies in Higher Education, 47(1), 159–176. https://doi.org/10.1080/03075079.2020.1735329

Chen, V., Sandford, A., LaGrone, M., Charbonneau, K., Kong, J., & Ragavaloo, S. (2022). An exploration of instructors' and students' perspectives on remote delivery of courses during the COVID?19 pandemic. British Journal of Educational Technology, 53(3), 512–533. https://doi.org/10.1111/bjet.13205

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). New York: Academic Press.

Coombs, A., DeLuca, C., LaPointe-McEwan, D., & Chalas, A. (2018). Changing approaches to classroom assessment: An empirical study across teacher career stages. Teach Teacher Education 71,134–144. https://doi.org/10.1016/j.tate.2017.12.010

Creswell, J. (2014). Qualitative, quantitative and mixed methods approaches: Sage.

Crosta, L., & Banda, V. (2021 ). Italian report on 21st Century skills. https://static1.squarespace.com/static/5dc28ad57b92e564895cd0b9/t/602e321586ec796adaaab973/1613640

Farrell, O. (2020). Out of intense complexities, intense simplicities emerge: Assessment and the pivot online. NIDL Blog. https://nidl.blog/2020/05/03/out-of-intense-complexities-intense-simplicities-emerge-assessment-and-the-pivot-online/

Fergus, S., Botha, M., & Scott, M. (2020). Insights gained during COVID-19: Refocusing laboratory assessments online. Journal of Chemical Education, 97(9), 3106–3109. https://doi.org/10.1021/acs.jchemed.0c00568

Field, A. (2009). Discovering statistics using SPSS (3rd ed.). SAGE Publications.

Gao, R., Lloyd, J., & Kim, Y. (2020). A desirable combination for undergraduate chemistry laboratories: Face-to-Face teaching with computer-aided, modifiable program for grading and assessment. Journal of Chemical Education, 97(9), 3028–3032. https://doi.org/10.1021/acs.jchemed.0c00634

Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & Education, 57(4), 2333–2351.

Greenhill, V. (2010). 21st Century Knowledge and Skills in Educator Preparation. Partnership for 21st century skills.

Hatzipanagos, S., Tait, A., & Amrane-Cooper, L. (2020). Towards a post COVID-19 digital authentic assessment practice: When radical changes enhance the student experience. Paper presented at the EDEN Proceedings 2020 Research Workshop | Lisbon, 21-23 October, 2020. https://doi.org/10.1016/j.compedu.2011.06.004

Hodges, C., & Barbour, M. (2021). Assessing learning during emergency remote education. Italian Journal of Educational Technology, 29(2), 85–98.

Huedo, M., Romero, C. , & Prieto-Andres, A. (2021). Spanish report on 21st Century skills. https://static1.squarespace.com/static/5dc28ad57b92e564895cd0b9/t/602f74e26a304f5bc0d2538d/

Jankowski, N. (2020). Assessment during a crisis: Responding to a global pandemic. National institute for learning outcomes assessment. https://www.learningoutcomesassessment.org/wp-content/uploads/2020/08/2020-COVID-Survey.pdf

Johnson, N., Veletsianos, G., & Seaman, J. (2020). US Faculty and administrators' experiences and epproaches in the early weeks of the COVID-19 pandemic. Online Learning, 24(2), 6–21. https://doi.org/10.24059/olj.v24i2.2285

Khodamoradi, A., Maghsoudi, M., & Saidi, M. (2022). Investigating the washback effect of online formative assessment (OFA) during the COVID-19 pandemic: A case of perceptual mismatches between prospective teachers and teacher educators. Practical Assessment, Research, and Evaluation, 27(1), 20. https://doi.org/10.7275/47ry-1n56

Kiger, M. , & Varpio, L. (2020). Thematic analysis of qualitative data: AMEE guide no. 131. Medical teacher, 42(8), 846–854. https://doi.org/10.1080/0142159x.2020.1755030

Lederman, D. (2020). Will shift to remote teaching be boon or bane for online learning. Inside Higher Ed, 18, 1-27. https://www.insidehighered.com/digital-learning/article/2020/03/18/most-teaching-going-remote-will-help-or-hurt-online-learning

Martínez-Mesa, J., González-Chica, D. , Duquia, R., Bonamigo, R. , & Bastos, J. (2016). Sampling how to select participants in my research study?. Anais brasileiros de dermatologia, 91(3), 326–330. https://doi.org/10.1590/abd1806-4841.20165254

Meccawy, Z., Meccawy, M., & Alsobhi, A. (2021). Assessment in 'survival mode': Student and faculty perceptions of online assessment practices in HE during COVID-19 pandemic. International Journal for Educational Integrity, 17(1), 1–24. https://doi.org/10.1007/s40979-021-00083-9

Miller, E., & Konstantinou, I. (2021). Using reflective, authentic assessments to embed employability skills in higher education. Journal of Work-Applied Management, 14(1), 4–17. https://doi.org/10.1108/jwam-02-2021-0014

MOE. (2020a). Guide to exams and evaluation arrangements COVID-19. https:// www.moe.gov.sa/en/HigherEducation/governmenthighereducation/Pages/ GuidetoEXandEV.aspx

MOE. (2020b). Guide to exams and evaluation arrangements. University semester work during the suspension of education for the prevention of COVID-19. https://www.moe.gov.sa/_layouts/15/MOEResp/Guide_Exams_Evaluation_ ArrangementsEn.pdf

Montenegro-Rueda, M., Luque-de la Rosa, A., Sarasola Sánchez-Serrano, J. , & Fernández-Cerero, J. (2021). Assessment in higher education during the COVID-19 pandemic: A systematic review. Sustainability, 13(19), 10509. https://doi.org/10.3390/su131910509

Nulty, D., (2008) The adequacy of response rates to online and paper surveys: What can be done? Assessment & Evaluation in Higher Education, 33(3), 301–314. https://doi.org/10.1080/02602930701293231

Pather, N., Blyth, P., Chapman, J., Dayal, M., Flack, N. , Fogg, Q., Meyer, A. (2020). Forced disruption of anatomy education in Australia and New Zealand: An acute response to the COVID?19 pandemic. Anatomical sciences education, 13(3), 284–300. https://doi.org/10.1002/ase.1968

Rahim, A. (2020). Guidelines for online assessment in emergency remote teaching during the COVID-19 Pandemic. Education in Medicine Journal, 12(2), 59-68. https://doi.org/10.21315/eimj2020.12.2.6

Rapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., & Koole, M. (2020). Online university teaching during and after the COVID-19 crisis: Refocusing teacher presence and learning activity. Postdigital science and education, 2(3), 923–945. https://doi.org/10.1007/s42438-020-00155-y

Saunders, P., Tractenberg, R. , Chaterji, R., Amri, H., Harazduk, N., Gordon, J., Haramati, A. (2007). Promoting self-awareness and reflection through an experiential mind-body skills course for first year medical students. Medical teacher, 29(8), 778–784. https://doi.org/10.1080/01421590701509647

Schuwirth, L., & Van der Vleuten, C. (2018). How to design a useful test: The principles of assessment. Understanding medical education: evidence, theory, and practice, 3, 275–289. https://doi.org/10.1002/9781119373780.ch20

Slade, C., Lawrie, G., Taptamat, N., Browne, E., Sheppard, K., & Matthews, K. (2022). Insights into how academics reframed their assessment during a pandemic: Disciplinary variation and assessment as afterthought. Assessment & Evaluation in Higher Education, 47(4), 588–605. https://doi.org/10.1080/02602938.2021.1933379

Soland, J., Hamilton, L., & Stecher, B. (2013). Measuring 21st Century Compentencies Guidance for Educators. Global Cities Education Network Report, RAND Corporation. https://en.unesco.org/icted/sites/default/files/2019-04/gcen-measuring21cskills.pdf

Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020). The role of authentic assessment to preserve academic integrity and promote skill development and employability. Studies in Higher Education, 45(11), 2132–2148. https://doi.org/10.1080/03075079.2019.1582015

Weleschuk, A., Dyjur, P., & Kelly, P. (2019). Online assessment in higher education. Canada: Taylor Institute for Teaching and Learning.

Wright, K. (2017). Researching internet-based populations: Advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web survey services. Journal of Computer-Mediated Communication, 10(3). https://doi.org/10.1111/j.1083-6101.2005.tb00259.x

Xie, J., Rice, M. , & Griswold, D. (2021). Instructional designers' shifting thinking about supporting teaching during and post-COVID-19. Distance Education, 42(3), 331–351. https://doi.org/10.1080/01587919.2021.1956305

Zilvinskis, J. (2015). Using authentic assessment to reinforce student learning in high-impact practices. Assessment Update, 27(6), 7–13. https://doi.org/10.1002/au.30040


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493