Computational Thinking Skill Level of Senior High School Students Majoring in Natural Science

Nur Huda, Eli Rohaeti

Abstract


Computational thinking (CT) is a skill integrated into various curricula in many countries. However, lack of student acceptance and limited assessment become challenges to integrating skill into the curriculum, specifically in developing countries like Indonesia. Therefore, this study aimed to validate the Indonesian version of the Computational Thinking Scale (CTS) and determine the CT skill level of high school students majoring in science. This study was conducted using a quantitative approach with a cross-sectional survey design. Participants were purposively selected based on certain criteria from a population of high schools in Yogyakarta, Indonesia. In this study, data were collected from 526 students with 19 items of CTS questionnaires and analysed using the Rasch model measurement. The findings showed that the adapted CTS met the fit criteria based on Rasch model measurement, except for one item. Based on the logit mean value of +1.69, the level of students' CT ability falls into the good category, where the most frequently implemented aspect is the problem-solving aspect, while the least frequently implemented aspect is algorithmic thinking. According to Differential Item Function analysis, there were differences in student responses based on coding experience. This study is expected to contribute to the field of CT assessment in science education. In addition, the results of this study can be an affirmation for educational policy makers in developing countries to integrate CT into the curriculum of natural science majors.

https://doi.org/10.26803/ijlter.23.1.17


Keywords


coding experiences; computational thinking skill; cross-sectional survey; gender; Rasch model measurement

Full Text:

PDF

References


Alfaro-Ponce, B., Patiño, A., & Sanabria-Z, J. (2023). Components of computational thinking in citizen science games and its contribution to reasoning for complexity through digital game-based learning: A framework proposal. Cogent Education, 10(1), Article 2191751. https://doi.org/10.1080/2331186X.2023.2191751

Andrich, D. (1988). Rasch models for measurement. SAGE. https://doi.org/10.4135/9781412985598

Angeli, C., & Giannakos, M. (2020). Computational thinking education: Issues and challenges. Computers in Human Behavior, 105, Article 106185. https://doi.org/10.1016/j.chb.2019.106185

Azizan, N. H., Mahmud, Z., & Rambli, A. (2021). Accuracy and Bias of the Rasch Rating Scale Person Estimates using Maximum Likelihood Approach: A Comparative Study of Various Sample Sizes. Journal of Physics: Conference Series, 2084(1), Article 012006. https://doi.org/10.1088/1742-6596/2084/1/012006

Bacelo, A., & Gómez-Chacón, I. M. (2023). Characterising algorithmic thinking: A university study of unplugged activities. Thinking Skills and Creativity, 48, Article 101284. https://doi.org/10.1016/j.tsc.2023.101284

Barr, V., & Stephenson, C. (2011). Bringing computational thinking to K-12: What is Involved and what is the role of the computer science education community? ACM Inroads, 2(1), 48–54. https://doi.org/10.1145/1929887.1929905

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures: Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014

Bond, T. (2015). Applying the Rasch Mode Fundamental Measurement in the Human Sciences (3rd ed.). Routledge. https://doi.org/10.4324/9781315814698

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer Netherlands. https://doi.org/10.1007/978-94-007-6857-4

Bradley, K. D., Peabody, M. R., Akers, K. S., & Knutson, N. M. (2015). Rating Scales in Survey Research: using the Rasch model to illustrate the middle category measurement. Survey Practice, 8(1), 1–12. https://doi.org/10.29115/SP-2015-0001

Cansu, F. K., & Cansu, S. K. (2019). An Overview of Computational Thinking. International Journal of Computer Science Education in Schools, 3(1), 17–30. https://doi.org/10.21585/ijcses.v3i1.53

Chagas, D., & Furtado, E. (2019). Computational Thinking in Basic Education in a Developing Country Perspective. In A. Visvizi & M. D. Lytras (Eds.), Research & Innovation Forum 2019 (pp. 135–150). Springer International Publishing. https://doi.org/10.1007/978-3-030-30809-4_14

Chan, S.-W., Looi, C.-K., & Sumintono, B. (2021). Assessing computational thinking abilities among Singapore secondary students: A Rasch model measurement analysis. Journal of Computers in Education, 8(2), 213–236. https://doi.org/10.1007/s40692-020-00177-2

Cheng, L., Wang, X., & Ritzhaupt, A. D. (2023). The Effects of Computational Thinking Integration in STEM on Students’ Learning Performance in K-12 Education: A Meta-analysis. Journal of Educational Computing Research, 61(2), 416–443. https://doi.org/10.1177/07356331221114183

Chongo, S., Osman, K., & Nayan, N. A. (2021). Impact of the Plugged-in and Unplugged Chemistry Computational Thinking Modules on Achievement in Chemistry. Eurasia Journal of Mathematics, Science and Technology Education, 17(4), em1953. https://doi.org/10.29333/ejmste/10789

Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed). Pearson.

CSTA, & ISTE (2011). Operational Definition of Computational Thinking for K-12 Education. http://www.iste.org/docs/pdfs/Operational-Definition-of-Computational-Thinking.pdf

Curzon, P., & McOwan, P. W. (2016). The power of computational thinking: Games, magic and puzzles to help you become a computational thinker. World Scientific. http://dx.doi.org/10.1142/q0054

Doleck, T., Bazelais, P., Lemay, D. J., Saxena, A., & Basnet, R. B. (2017). Algorithmic thinking, cooperativity, creativity, critical thinking, and problem solving: Exploring the relationship between computational thinking skills and academic performance. Journal of Computers in Education, 4(4), 355–369. https://doi.org/10.1007/s40692-017-0090-9

Dolgopolovas, V., Jevsikova, T., & Dagiene, V. (2018). From Android games to coding in C—An approach to motivate novice engineering students to learn programming: A case study. Computer Applications in Engineering Education, 26(1), 75–90. https://doi.org/10.1002/cae.21862

Durak, H. Y., Yilmaz, F. G. K., & Yilmaz, R. (2019). Computational Thinking, Programming Self-Efficacy, Problem Solving and Experiences in the Programming Process Conducted with Robotic Activities. Contemporary Educational Technology, 10(2), 173–197. https://doi.org/10.30935/cet.554493

Ertugrul-Akyol, B. (2019). Development of Computational Thinking Scale: Validity and Reliability Study. International Journal of Educational Methodology, 5(3), 421–432. https://doi.org/10.12973/ijem.5.3.421

Gill, J., Johnson, P., & Clark, M. (2010). Research methods for managers (4th ed). SAGE.

Gök, A., & Karamete, A. (2023). A validity and reliability study of the Turkish computational thinking scale. Journal of Educational Technology and Online Learning, 6(2), 421–437. https://doi.org/10.31681/jetol.1217363

Huda, N., & Rohaeti, E. (2023). The Factors That Influence the Motivation to Learn Chemistry of Upper-Secondary School Students In Indonesia. Journal of Baltic Science Education, 22(4), 615–630. https://doi.org/10.33225/jbse/23.22.615

Hurt, T., Greenwald, E., Allan, S., Cannady, M. A., Krakowski, A., Brodsky, L., Collins, M. A., Montgomery, R., & Dorph, R. (2023). The computational thinking for science (CT-S) framework: Operationalizing CT-S for K–12 science education researchers and educators. International Journal of STEM Education, 10(1), Article 1. https://doi.org/10.1186/s40594-022-00391-7

Isa, N. M., & Naim, H. A. (2016). Science Process Skill Assessment: Teachers Practice and Competency. In Q. Zhang (Ed.), Pacific Rim Objective Measurement Symposium (PROMS) 2015 Conference Proceedings (pp. 251–266). Springer Singapore. https://doi.org/10.1007/978-981-10-1687-5_16

Khine, M. S. (Ed.). (2020). Rasch Measurement: Applications in Quantitative Educational Research. Springer Singapore. https://doi.org/10.1007/978-981-15-1800-3

Korkmaz, Ö., & Bai, X. (2019). Adapting Computational Thinking Scale (CTS) for Chinese High School Students and Their Thinking Scale Skills Level. Participatory Educational Research, 6(1), 10–26. https://doi.org/10.17275/per.19.2.6.1

Korkmaz, Ö., Çakir, R., & Özden, M. Y. (2017). A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior, 72, 558–569. https://doi.org/10.1016/j.chb.2017.01.005

Krejcie, R. V., & Morgan, D. W. (1970). Determining Sample Size for Research Activities. Educational and Psychological Measurement, 30(3), 607–610. https://doi.org/10.1177/001316447003000308

Kukul, V., & Karatas, S. (2019). Computational Thinking Self-Efficacy Scale: Development, Validity and Reliability. Informatics in Education, 18(1), 151–164. https://doi.org/10.15388/infedu.2019.07

Li, Y., Schoenfeld, A. H., diSessa, A. A., Graesser, A. C., Benson, L. C., English, L. D., & Duschl, R. A. (2020). Computational Thinking Is More about Thinking than Computing. Journal for STEM Education Research, 3(1), 1–18. https://doi.org/10.1007/s41979-020-00030-2

Linacre, J. M. (1994). Many-facet Rasch measurement (2nd ed). MESA Press.

Masters, G. N. (1982). A rasch model for partial credit scoring. Psychometrika, 47(2), 149–174. https://doi.org/10.1007/BF02296272

Matsumoto, P. S., & Cao, J. (2017). The Development of Computational Thinking in a High School Chemistry Course. Journal of Chemical Education, 94(9), 1217–1224. https://doi.org/10.1021/acs.jchemed.6b00973

Natali, V. (2022). Computational Thinking, Mata Kuliah Pilihan [Computational Thinking, Elective Course]. Direktorat Pendidikan Profesi Guru.

Natali, V., & Nugraheni, C. E. (2023). Indonesian Bebras Challenge 2021 ExploratoryData Analysis. Olympiads in Informatics, 17, 65–85. https://doi.org/10.15388/ioi.2023.06

Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.

Nurwita, F., Kusumah, Y. S., & Priatna, N. (2022). Exploring students’ mathematical computational thinking ability in solving pythagorean theorem problems. Al-Jabar : Jurnal Pendidikan Matematika, 13(2), 273–287. https://doi.org/10.24042/ajpm.v13i2.12496

OECD. (2019). PISA 2018 Results (Volume I): What Students Know and Can Do. OECD. https://doi.org/10.1787/5f07c754-en

Ogegbo, A. A., & Ramnarain, U. (2022). A systematic review of computational thinking in science classrooms. Studies in Science Education, 58(2), 203–230. https://doi.org/10.1080/03057267.2021.1963580

Papert, S. (1996). An exploration in the space of mathematics educations. International Journal of Computers for Mathematical Learning, 1(1), 95–123. https://doi.org/10.1007/BF00191473

Purnami, W., Fauzi, A., & Naingalis, M. L. P. (2023). Computational thinking skills identification among students of physics education department using Rasch model analysis. Article 100012. https://doi.org/10.1063/5.0143158

Putra, Z. H., Ramiati, Zufriady, Hidayat, R., Jismulatif, Hermita, N., & Sulistiyo, U. (2022). Development of computational thinking tasks based on Riau Malay culture: A study of fifth-grade public school students in Pekanbaru, Indonesia. Education 3-13, 1–11. https://doi.org/10.1080/03004279.2022.2150063

Richardo, R. R., Dwiningrum, S. I. A., & Wijaya, A. (2023). Computational Thinking Skill For Mathematics and Attitudes Based on Gender: Comparative and Relationship Analysis. Pegem Journal of Education and Instruction, 13(02), 345–353. https://doi.org/10.47750/pegegog.13.02.38

Romero, M., Lepage, A., & Lille, B. (2017). Computational thinking development through creative programming in higher education. International Journal of Educational Technology in Higher Education, 14(1), Article 42. https://doi.org/10.1186/s41239-017-0080-z

Rosali, D. F., & Suryadi, D. (2021). An Analysis of Students’ Computational Thinking Skills on The Number Patterns Lesson during The Covid-19 Pandemic. Formatif: Jurnal Ilmiah Pendidikan MIPA, 11(2), 216–232. https://doi.org/10.30998/formatif.v11i2.9905

Rubinstein, A., & Chor, B. (2014). Computational Thinking in Life Science Education. PLoS Computational Biology, 10(11), Article e1003897. https://doi.org/10.1371/journal.pcbi.1003897

Saad, A. (2020). Students’ Computational Thinking Skill through Cooperative Learning Based on Hands-on, Inquiry-based, and Student-centric Learning Approaches. Universal Journal of Educational Research, 8(1), 290–296. https://doi.org/10.13189/ujer.2020.080135

Saidin, N. D., Khalid, F., Martin, R., Kuppusamy, Y., & Munusamy, N. A. (2021). Benefits and Challenges of Applying Computational Thinking in Education. International Journal of Information and Education Technology, 11(5), 248–254. https://doi.org/10.18178/ijiet.2021.11.5.1519

Selby, C., & Woollard, J. (2013). Computational thinking: The developing definition. Conference: Special Interest Group on Computer Science Education (SIGCSE).

Seow, P., Looi, C.-K., How, M.-L., Wadhwa, B., & Wu, L.-K. (2019). Educational Policy and Implementation of Computational Thinking and Programming: Case Study of Singapore. In S.-C. Kong & H. Abelson (Eds.), Computational Thinking Education (pp. 345–361). Springer Singapore. https://doi.org/10.1007/978-981-13-6528-7_19

Sick, J. (2010). Rasch Measurement in language education Part 5: Assumptions and requirements of Rasch measurement. Shiken: JALT Testing & Evaluation SIG Newsletter, 14(2), 23–29.

Sondakh, D. E., Pungus, S. R., & Putra, E. Y. (2022). Indonesian Undergraduate Students’ Perception of Their Computational Thinking Ability. CogITo Smart Journal, 8(1), 68–80. https://doi.org/10.31154/cogito.v8i1.387.68-80

Sovey, S., Osman, K., & Mohd Matore, M. E. E. (2022). Rasch Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students. Eurasia Journal of Mathematics, Science and Technology Education, 18(3), em2088. https://doi.org/10.29333/ejmste/11794

Su, J., & Yang, W. (2023). A systematic review of integrating computational thinking in early childhood education. Computers and Education Open, 4, Article 100122. https://doi.org/10.1016/j.caeo.2023.100122

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan [Application of Rasch Modelling to Educational Assessment]. Trim Komunikata Publishing House.

Sun, L., Hu, L., & Zhou, D. (2022). Programming attitudes predict computational thinking: Analysis of differences in gender and programming experience. Computers & Education, 181, Article 104457. https://doi.org/10.1016/j.compedu.2022.104457

Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers & Education, 148, Article 103798. https://doi.org/10.1016/j.compedu.2019.103798

Tsai, M.-J., Liang, J.-C., & Hsu, C.-Y. (2021). The Computational Thinking Scale for Computer Literacy Education. Journal of Educational Computing Research, 59(4), 579–602. https://doi.org/10.1177/0735633120972356

Villalustre, L., & Cueli, M. (2023). Assessing the Computational Thinking of Pre-Service Teachers: A Gender and Robotics Programming Experience Analysis. Education Sciences, 13(10), Article 1032. https://doi.org/10.3390/educsci13101032

Voogt, J., Fisser, P., Good, J., Mishra, P., & Yadav, A. (2015). Computational thinking in compulsory education: Towards an agenda for research and practice. Education and Information Technologies, 20(4), 715–728. https://doi.org/10.1007/s10639-015-9412-6

Wang, X., & Cheng, Z. (2020). Cross-Sectional Studies. Chest, 158(1), S65–S71. https://doi.org/10.1016/j.chest.2020.03.012

Wardani, R., Zakaria, M., Priyanto, P., Luthfi, M. I., Rochmah, I. N., Rahman, A. F., & Putra, M. T. M. (2022). An Authentic Learning Approach to Assist the Computational Thinking in Mathematics Learning for Elementary School. Elinvo (Electronics, Informatics, and Vocational Education), 6(2), 139–148. https://doi.org/10.21831/elinvo.v6i2.47251

Weintrop, D., Beheshti, E., Horn, M., Orton, K., Jona, K., Trouille, L., & Wilensky, U. (2016). Defining Computational Thinking for Mathematics and Science Classrooms. Journal of Science Education and Technology, 25(1), 127–147. https://doi.org/10.1007/s10956-015-9581-5

Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33–35. https://doi.org/10.1145/1118178.1118215

Yang, D., Snelson, C., & Feng, S. (2023). Identifying computational thinking in students through project-based problem-solving activities. Information Discovery and Delivery, 51(3), 293–305. https://doi.org/10.1108/IDD-09-2022-0091

Zamzami, E. M., Tarigan, J. T., Zendrato, N., Muis, A., Yoga, A. P., & Faisal, M. (2020). Exercising the Students Computational Thinking Ability using Bebras Challenge. Journal of Physics: Conference Series, 1566(1), Article 012113. https://doi.org/10.1088/1742-6596/1566/1/012113


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493