Integration of Chat-GPT Usage in Language Learning Model to Improve Argumentation Skills, Complex Comprehension Skills, and Critical Thinking Skills

Egi Nusivera, Ade Hikmat, Abdul Rahman A. Ghani

Abstract


This study aims to investigate the effects of integrating Chat-GPT usage in language learning model on students’ argumentation ability, complex comprehension ability, and critical thinking ability. The method used in this study is quasi-experimental to investigate the impact of integrating Chat-GPT usage in a large language model on students’ argumentation and critical thinking ability. Participants involved in this study were 350 students in higher education from semesters 1-6 who were divided into two groups, namely experimental and control. The experimental group received debate intervention integrating Chat-GPT, while the control group received conventional debate intervention. Assessment was conducted in the pretest and posttest phases to assess argumentation ability and critical thinking ability. The findings of the study indicate that integrating Chat-GPT usage in scientific debate language learning model can significantly improve argumentation ability, critical thinking ability, and complex concept understanding compared to argumentation ability and critical thinking ability of students in the conventional debate group. Student interaction with artificial intelligence (AI) Chat-GPT will produce a dialogue that encourages students to analyze, evaluate, and synthesize information, which is a major component in critical thinking skills. Through this process, students’ argumentative skills will be trained because AI directly challenges students to provide strong arguments with varying points of view. The findings of this study imply that AI integration in education should align with specific learning objectives and targeted skill development goals. This study contributes to the use of AI-based educational devices in education and the learning process can be used as a policy in education. 

https://doi.org/10.26803/ijlter.24.2.19


Keywords


argumentation skills; complex comprehension skills; critical thinking skills; integration of Chat-GPT; language learning model

Full Text:

PDF

References


Alkhabra, Y. A., Ibrahem, U. M., & Alkhabra, S. A. (2023). Augmented reality technology in enhancing learning retention and critical thinking according to STEAM program. Humanities and Social Sciences Communications, 10(1), Article 174. https://doi.org/10.1057/s41599-023-01650-w

Aloisi, C., & Callaghan, A. (2018). Threats to the validity of the collegiate learning assessment (Cla+) as a measure of critical thinking skills and implications for learning gain. Higher Education Pedagogies, 3(1), 57–82. https://doi.org/10.1080/23752696.2018.1449128

Barak, M., & Dori, Y. J. (2009). Enhancing higher order thinking skills among inservice science teachers via embedded assessment. Journal of Science Teacher Education, 20(5), 459–474. https://doi.org/10.1007/s10972-009-9141-z

Bates, J., Cheng, S., Ferris, M., & Wang, F. (2024). Cultivating critical thinking skills: A pedagogical study in a business statistics course. Journal of Statistics and Data Science Education, 1–11. https://doi.org/10.1080/26939169.2024.2394534

Crawford, J., Allen, K. A., Pani, B., & Cowling, M. (2024). When artificial intelligence substitutes humans in higher education: The cost of loneliness, student success, and retention. Studies in Higher Education, 49(5), 883–897. https://doi.org/10.1080/03075079.2024.2326956

Dawson, C., Julku, H., Pihlajamäki, M., Kaakinen, J. K., Schooler, J. W., & Simola, J. (2024). Evidence-based scientific thinking and decision-making in everyday life. Cognitive Research: Principles and Implications, 9(1), Article 50. https://doi.org/10.1186/s41235-024-00578-2

Delcker, J., Heil, J., Ifenthaler, D., Seufert, S., & Spirgi, L. (2024). First-year students AI-competence as a predictor for intended and de facto use of AI-tools for supporting learning processes in higher education. International Journal of Educational Technology in Higher Education, 21(1), Article 18. https://doi.org/10.1186/s41239-024-00452-7

Du, H., Sun, Y., Jiang, H., Islam, A. Y. M. A., & Gu, X. (2024). Exploring the effects of AI literacy in teacher learning: An empirical study. Humanities and Social Sciences Communications, 11(1), Article 559. https://doi.org/10.1057/s41599-024-03101-6

Elsayed, A. M., Kholikov, A., Abdullayeva, I., Al-Farouni, M., & Wodajo, M. R. (2024). Teacher support in AI-assisted exams: An experimental study to inspect the effects on demotivation, anxiety management in exams, L2 learning experience, and academic success. Language Testing in Asia, 14(1), Article 53. https://doi.org/10.1186/s40468-024-00328-7

García-Carmona, A. (2023). Scientific thinking and critical thinking in science education: Two distinct but symbiotically related intellectual processes. Science and Education. https://doi.org/10.1007/s11191-023-00460-5

Hsu, T. C., & Chen, M. S. (2024). Effects of students using different learning approaches for learning computational thinking and AI applications. Education and Information Technologies. https://doi.org/10.1007/s10639-024-13116-w

Kerruish, E. (2024). Postdigital teaching of critical thinking in higher education: Non-instrumentalised sociality and interactivity. Postdigital Science and Education. https://doi.org/10.1007/s42438-024-00456-6

Khan, M. A., Kurbonova, O., Abdullaev, D., Radie, A. H., & Basim, N. (2024). Is AI-assisted assessment liable to evaluate young learners? Parents support, teacher support, immunity, and resilience are in focus in testing vocabulary learning. Language Testing in Asia, 14(1), Article 48. https://doi.org/10.1186/s40468-024-00324-x

Landrieu, Y., de Smedt, F., van Keer, H., & de Wever, B. (2024). Argumentation in collaboration: The impact of explicit instruction and collaborative writing on secondary school students’ argumentative writing. Reading and Writing, 37(6), 1407–1434. https://doi.org/10.1007/s11145-023-10439-x

Lee, D., Kim, H.-h, & Sung, S.-H. (2023). Development research on an AI English learning support system to facilitate learner-generated-context-based learning. Educational Technology Research and Development, 71(2), 629–666. https://doi.org/10.1007/s11423-022-10172-2

Liu, Y., Yang, M., & Guo, Z. (2022). Reinforcement learning based optimal decision making towards product lifecycle sustainability. International Journal of Computer Integrated Manufacturing, 35(10–11), 1269–1296. https://doi.org/10.1080/0951192X.2022.2025623

Loyens, S. M. M., van Meerten, J. E., Schaap, L., & Wijnia, L. (2023). Situating higher-order, critical, and critical-analytic thinking in problem- and project-based learning environments: A systematic review. Educational Psychology Review, 35(2), Article 39. https://doi.org/10.1007/s10648-023-09757-x

Magana, A. J., Arigye, J., Udosen, A., Lyon, J. A., Joshi, P., & Pienaar, E. (2024). Scaffolded team-based computational modeling and simulation projects for promoting representational competence and regulatory skills. International Journal of STEM Education, 11(1), Article 34. https://doi.org/10.1186/s40594-024-00494-3

Manassero-Mas, M. A., & Vázquez-Alonso, Á. (2022). An empirical analysis of the relationship between nature of science and critical thinking through science definitions and thinking skills. SN Social Sciences, 2(12), Article 270. https://doi.org/10.1007/s43545-022-00546-x

Manning, M. N. J. (2024). University lecturers’ lived experiences of teaching critical thinking in Australian university: A hermeneutic phenomenological research. Higher Education, 88(6), 2057–2073. https://doi.org/10.1007/s10734-024-01200-6

Mansour, N. (2024). Students’ and facilitators’ experiences with synchronous and asynchronous online dialogic discussions and e-facilitation in understanding the nature of science. Education and Information Technologies, 29(12), 15965–15997. https://doi.org/10.1007/s10639-024-12473-w

Mullan, F., Mather, H., Bateman, H., Cairns, A., Nasseripour, M., Binnie, V., Dawson, L., McCracken, G., & Ellis, J. (2024). Recognising and supporting authentic learning in a changing world: The opportunities and threats of AI. British Dental Journal, 237(8), 659–662. https://doi.org/10.1038/s41415-024-7948-9

Olczak, J., Pavlopoulos, J., Prijs, J., Ijpma, F. F. A., Doornberg, J. N., Lundström, C., Hedlund, J., & Gordon, M. (2021). Presenting artificial intelligence, deep learning, and machine learning studies to clinicians and healthcare stakeholders: An introductory reference with a guideline and a clinical AI research (CAIR) checklist proposal. Acta Orthopaedica, 92(5), 513–525. https://doi.org/10.1080/17453674.2021.1918389

Pally, M. (2001). Skills development in ‘sustained’ content-based curricula: Case studies in analytical/critical thinking and academic writing. Language and Education, 15(4), 278–305. https://doi.org/10.1080/09500780108666814

Polakova, P., & Klimova, B. (2024). Implementation of AI-driven technology into education: A pilot study on the use of chatbots in foreign language learning. Cogent Education, 11(1), Article 2355385. https://doi.org/10.1080/2331186X.2024.2355385

Renninger, K. A., Gantt, A. L., & Lipman, D. A. (2023). Comprehension of argumentation in mathematical text: What is the role of interest? ZDM – Mathematics Education, 55(2), 371–384. https://doi.org/10.1007/s11858-022-01445-4

Rienties, B., Domingue, J., Duttaroy, S., Herodotou, C., Tessarolo, F., & Whitelock, D. (2024). What distance learning students want from an AI digital assistant. Distance Education, 1–17. https://doi.org/10.1080/01587919.2024.2338717

Sanders, D. A., & Mukhari, S. S. (2024). Lecturers’ perceptions of the influence of AI on a blended learning approach in a South African higher education institution. Discover Education, 3(1), Article 135. https://doi.org/10.1007/s44217-024-00235-2

Strohmaier, A. R., Reinhold, F., Hofer, S., Berkowitz, M., Vogel-Heuser, B., & Reiss, K. (2022). Different complex word problems require different combinations of cognitive skills. Educational Studies in Mathematics, 109(1), 89–114. https://doi.org/10.1007/s10649-021-10079-4

Tang, Y., Lin, Z., Zhou, L., Wang, W., Wen, L., Zhou, Y., Ge, Z., Chen, Z., Dai, W., Yang, Z., Tang, H., & Lan, W. (2024). AI sees beyond humans: Automated diagnosis of myopia based on peripheral refraction map using interpretable deep learning. Journal of Big Data, 11(1), Article 125.

https://doi.org/10.1186/s40537-024-00989-4

Tirado-Olivares, S., Cózar-Gutiérrez, R., López-Fernández, C., & González-Calero, J. A. (2023). Training future primary teachers in historical thinking through error-based learning and learning analytics. Humanities and Social Sciences Communications, 10(1), Article 44. https://doi.org/10.1057/s41599-023-01537-w

Uçar, B., & Demiraslan Çevik, Y. (2020). The effect of argument mapping supported with peer feedback on pre-service teachers’ argumentation skills. Journal of Digital Learning in Teacher Education, 37(1), 6–29. https://doi.org/10.1080/21532974.2020.1815107

Utriainen, J., Marttunen, M., Kallio, E., & Tynjälä, P. (2017). University applicants’ critical thinking skills: The case of the Finnish educational sciences. Scandinavian Journal of Educational Research, 61(6), 629–649. https://doi.org/10.1080/00313831.2016.1173092

Vicente, J. J., Franco-Mariscal, A. J., & Oliva, J. M. (2024). Enhancing argumentation and decision-making of preservice Early Childhood Education teachers through role-playing on animal experimentation. Science and Education. https://doi.org/10.1007/s11191-024-00529-9

Whiley, D., Witt, B., Colvin, R. M., Sapiains Arrue, R., & Kotir, J. (2017). Enhancing critical thinking skills in first year environmental management students: A tale of curriculum design, application and reflection. Journal of Geography in Higher Education, 41(2), 166–181. https://doi.org/10.1080/03098265.2017.1290590

Young, S. A., Newton, A. R., Fowler, S. R., & Park, J. (2023). Critical thinking activities in Florida undergraduate biology classes improves comprehension of climate change. Journal of Biological Education, 57(1), 184–195. https://doi.org/10.1080/00219266.2021.1877785

Zhang, S., Zhao, X., Nan, D., & Kim, J. H. (2024). Beyond learning with cold machine: Interpersonal communication skills as anthropomorphic cue of AI instructor. International Journal of Educational Technology in Higher Education, 21(1), Article 27. https://doi.org/10.1186/s41239-024-00465-2


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493