Assessing the Assessors: Language Assessment Knowledge and Beliefs in Thai Preservice English Teachers

Atthasit Ketkumbonk, Apisak Sukying

Abstract


This study investigates the evolution of language assessment knowledge (LAK) and language assessment (LA) beliefs among 54 Thai preservice English teachers from a public university in northeastern Thailand during their teaching practicum. The participants were selected using convenience sampling. While language assessment literacy (LAL) remains a developing area with varied levels across different contexts, this research addresses the gap by examining changes in LAK and beliefs over time. Using parallel LAK tests and a detailed LA beliefs questionnaire based on Taylor’s (2013) framework, assessments were conducted at the beginning (T1) and end (T2) of the semester. Data were analyzed using descriptive and inferential statistics. The findings revealed a slight improvement in LAK, with mean scores increasing from 31.3 (56.9%) at T1 to 33.19 (60.34%) at T2, indicating a medium level of LAL, though the change was not statistically significant. Despite the modest improvement in technical skills, there was a notable decline in applying local assessment practices. However, the preservice English teachers consistently rated the importance of language assessment highly, with a significant growth in their personal beliefs and attitudes. The study also identified a small but statistically significant correlation between LAK and LA beliefs, highlighting the context-bound nature of assessment practices. These findings highlight the need for context-sensitive training in teacher education programs to better prepare preservice teachers for real-world challenges, emphasizing the importance of integrating theoretical knowledge with practical applications. Further research is recommended to explore these dynamics over a longer period and across diverse educational settings.

https://doi.org/10.26803/ijlter.23.12.3


Keywords


Language assessment literacy, language assessment knowledge, preservice English teachers, beliefs and practices

Full Text:

PDF

References


Azkiyah, S. N., Rahmawati, Y., Shohibussirri, M., Nisa, Y. F., Sunengsih, N., & Mukminin, A. (2023). English proficiency as a predictor of academic performance in the context of non-English as a medium of instruction. PASAA, 65, 32–56. https://doi.org/10.58837/CHULA.PASAA.65.1.2

Basic Education Commission. (2008). Basic education core curriculum B.E. 2551 (AD 2008). Office of Basic Educational Commission of Thailand. http://academic.obec.go.th/images/document/1525235513_d_1.pdf

Bohn, H., & Tsagari, D. (2021). Teacher educators’ conceptions of language assessment literacy in Norway. Journal of Language Teaching and Research, 12(2), 222-233. https://doi.org/10.17507/jltr.1202.02

Bohn, H., & Tsagari, D. (2022). Language assessment literacy: Understanding the construct from Norwegian EFL teachers’ perspective. Studies in Language Assessment, 11(1), 119-148. https://doi.org/10.58379/UNUD5510

Borg, M. (2001). Key concepts in ELT: Teachers’ beliefs. ELT Journal, 55(2), 186–187.

https://doi.org/10.1093/eltj/55.2.186

Brindley, G. (2001). Language assessment and professional development. In C. Elder, K. Brown, N. Hill, T. Iwashita, T. Lumley, T. McNamara, & K. O’Loughlin (Eds.), Experimenting with uncertainty: Essays in honor of Alan Davies (pp. 126–136). Cambridge University Press. https://books.google.fm/books?id=AM78PZND2hEC&printsec=frontcover#v=onepage&q&f=false

Brown, J. D. (2014). The future of World Englishes in language testing. Language Assessment Quarterly, 11(1), 5-26. https://doi.org/10.1080/15434303.2013.869817

Creswell, J. W., & Cresswell, D. J. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage. https://spada.uns.ac.id/pluginfile.php/510378/mod_resource/content/1/creswell.pdf

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555

Cui, Y., Liu, Y., Yu, H., & Gao, Y. (2022). Developing English teachers’ language assessment literacy in an EAP reform context through test design: A case study. System, 109, 1-12. https://doi.org/10.1016/j.system.2022.102866

Dashti, S. (2019). EFL teachers’ beliefs and practices about classroom assessment: A multiple case study in the context of Kuwait [Unpublished doctoral dissertation]. York University. https://core.ac.uk/download/pdf/240104006.pdf

Davies, A. P. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327-347. https://doi.org/10.1177/0265532208090156

Devi, A. (2023). The relationship between English proficiency and academic achievement of Indonesian EFL postgraduate students. Journal of English Language Learning (JELL), 7(1), 303-308. https://doi.org/10.31949/jell.v7i1.5566

Douglas, D. (2010). Understanding language testing. Routledge. https://doi.org/10.4324/9780203776339

Farhady, H., & Tavassoli, K. (2021). EFL teachers’ perceptions and practices of their language assessment knowledge. Language Testing in Asia, 11(17), 1-20. https://doi.org/10.1186/s40468-021-00135-4

Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. https://doi.org/10.1080/15434303.2011.642041

Geide-Stevenson, D. (2018). Does English proficiency affect academic performance? International Review of Economics Education, 28, 41-48. https://doi.org/10.1016/j.iree.2018.04.002

Genç, E., Çal??kan, H., & Yüksel, D. (2020). Language assessment literacy level of EFL teachers: A focus on writing and speaking assessment knowledge of the teachers. Sakarya University Journal of Education, 10(2), 274-291. https://doi.org/10.19126/suje.626156

Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of preservice language teachers. Colombian Applied Linguistics Journal, 21(2), 243-259. https://doi.org/10.14483/22487085.14514

Güngör, M., A. & Güngör, M., N. (2023). Developing preservice teachers’ assessment literacy in the practicum: an action research study. Australian Journal of Teacher Education, 48(7), 73-88. https://doi.org/ 10.14221/1835-517x.6182

Geide-Stevenson, D. (2018). Does English proficiency affect academic performance? International Review of Economics Education, 28, 41-48. https://doi.org/10.1016/j.iree.2018.04.002

Ghenghesh, P. (2015). The relationship between English language proficiency and academic performance of university students – Should academic institutions really be concerned? International Journal of Applied Linguistics & English Literature, 4(2), 91-97. https://doi.org/10.7575/aiac.ijalel.v.4n.2p.91

Giraldo, F. (2021). Language assessment literacy and teachers’ professional development: A review of the literature. Profile Issues in Teacher’ Professional Development, 23(2), 265– 279. https://doi.org/10.15446/profile.v23n2.90533

Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of preservice language teachers. Colombian Applied Linguistics Journal, 21(2), 243-259. https://doi.org/10.14483/22487085.14514

Imsa-ard, P., Wichamuk, P., & Chuanchom, C. (2021). Muffled voices from Thai preservice teachers: Challenges and difficulties during teaching practicum. Shanlax International Journal of Education, 9(3), 246-260. https://doi.org/10.34293/education.v9i3.3989

Imsa-ard, P., & Tangkiengsirisin, S. (2023). Language assessment literacy: A preliminary survey of Thai EFL university lecturers’ language assessment knowledge, beliefs, and practices. PASAA Journal, 66, 37-80. https://www.culi.chula.ac.th/Images/asset/pasaa_journal/file-71-887-z93djk716327.pdf

Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment (3rd ed.). Springer.

Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158

Kremmel, B., & Harding, B. (2019). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 1-22. https://doi.org/10.1080/15434303.2019.1674855

Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61, 112-122. https://doi.org/10.1016/j.stueduc.2019.03.003

Namsaeng, P. (2022). Thai EFL trainee teachers’ perceptions on teacher training. Journal of Language, Religion and Culture, 1(11), 202-227.

https://so03.tci-thaijo.org/index.php/gshskku/article/view/257942

Nikmard, F., & Zohre, M. Z. (2020). Designing and validating a potential assessment inventory for assessing ELTs’ assessment literacy. Language Testing in Asia, 10(8), 1-19. https://doi.org/10.1186/s40468-020-00106-1

Martirosyan, N. M., Hwang, E., & Wanjohi, R. (2015). Impact of English proficiency on academic performance of international students. Journal of International Students, 5(1), 60-71. https://doi.org/10.32674/jis.v5i1.443

Ölmezer-Öztürk, E., & Aydin, B. (2018). Toward measuring language teachers’ assessment knowledge: Development and validation of language assessment knowledge scale (LAKS) assessment literacy survey. Language Assessment Quarterly, 17(1), 100-120. https://doi.org/10.1186/s40468-018-0075-2

Ölmezer Öztürk, E. (2021). Developing language assessment literacy of EFL preservice teachers through classroom assessment course. International Journal of Contemporary Educational Research, 8(3), 13-22. https://doi.org/10.33200/ijcer.932721

Pallant, J. (2005). SPSS survival guide: A step by step guide to data analysis using SPSS for Windows (3rd ed.). Open University Press.

Pill, J., & Harding, L. (2013). Defining the language assessment literacy gap: Evidence from a parliamentary inquiry. Language Testing, 30(3), 381-402. https://doi.org/10.1177/0265532213480337

Prastikawati, E., Mujiyanto, J., Saleh, M. & Fitriati, W. Language assessment course: impact on preservice EFL teachers’ language assessment literacy. ISET: International Conference on Science, Education and Technology, 7(1), 160-167. https://doi.org/10.26858/ijole.v7i4.47445

Puspawati, I. (2019). Understanding teachers’ knowledge, skills, and principles on language assessment: A survey on teachers’ language assessment literacy. Advances in Social Science, Education and Humanities Research, (353), 70-75. http://creativecommons.org/licenses/by-nc/4.0/

Rahimi, S. A., Razmjoo, S. A., Sahragard, R., & Ahmadi, A. R. (2021). Development and validation of language assessment literacy scale for high school EFL teachers: A mixed methods approach. Teaching English Language, 15(2), 229-262. https://doi.org/10.22132/TEL.2021.142934

Rezai, A., Alibakhshi, G., Farokhipour, S., & Miri, M. (2021). A phenomenographic study on language assessment literacy: Hearing from Iranian university teachers. Language Testing in Asia, 11(26), 1-25. https://doi.org/10.1186/s40468-021-00142-5

Richards, J. C., & Rodgers, T. S. (2014). Approaches and methods in language teaching (3rd ed.). Cambridge University Press.

Royal Thai Government Gazette. (2020). Standard of knowledge and teaching professional experience, Teacher’s Council of Thailand (Issue 4). Ministry of Education. https://www.ksp.or.th/ksp2018/2020/06/19628/

Ryan, K. (2018). An investigation of preservice teacher assessment literacy and assessment confidence: Measure development and EDTPA performance [Unpublished doctoral dissertation]. Kent State University. https://www.proquest.com/docview/2059239070

Rudd, M., & Honkiss, L. (2020). Analysing the correlation between English proficiency and academic performance among Thai university students. Athens Journal of Education, 7(1), 122-138. https://doi.org/10.30958/aje.7-1-6

Sakon Nakhon Rajabhat University’s Center of Teaching Professional Internship. (2020).

Teaching professional internship manual in academic year of 2020 [????????????????????????????? ?????????? ????]. Sakon Nakhon Rajabhat University Publication.

Stiggins, R. J. (1999). Evaluating classroom assessment training in teacher education programs. Issues and Practice, 18(1), 23–27. https://doi.org/10.1111/j.17453992.1999.tb00004.x

Sevimel-Sahin, A. (2021). Language assessment literacy of novice EFL teachers: Perceptions, experiences, and training. In S. Hidri (Ed.), Perspectives on language assessment literacy: Challenges for improving students’ learning (pp. 3-12). Routledge.

Tao, N. (2014). Development and validation of classroom assessment literacy scales: English as a foreign language (EFL) instructor in a Cambodian higher education setting [Unpublished doctoral dissertation]. Victoria University. https://vuir.vu.edu.au/25850/

Tajeddin, Z., Khatib, M., & Mahdavi, M. (2022). Critical language assessment literacy of EFL teachers: Scale construction and validation. Language Testing, 39(4), 649–678. https://doi.org/10.1177/02655322211057040

Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/02655322134803

Thong-Iam, N., & Subphadoongchone, P. (2017). Professional development needs of Thai EFL university teachers: A focus on the assessment literacy and practice of student self-assessment in classrooms. Humanities, 40(2), 56-72. http://ejournals.swu.ac.th/index.php/hm/article/view/11905

Karin Vogt, Dina Tsagari & Georgios Spanoudis (2020) What do teachers think they want? A comparative study of in-Service language teachers’ beliefs on LAL training needs, Language Assessment Quarterly, 17(4), 386-409, https://doi.org/ 10.1080/15434303.2020.1781128

Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010

Yamtim, V., & Wongwanich, S. (2014). A study of classroom assessment literacy of primary school teachers. Procedia - Social and Behavioral Sciences, (116), 2998-3004. https://doi.org/10.1016/j.sbspro.2014.01.696

Yan, X., Zhang, C., & Fan, J. J. (2017). Assessment knowledge is important, but …”: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158-168. https://doi.org/10.1016/j.system.2018.03.003


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493