Assessing Learning Outcomes Through Digital Game-Playing: A Systematic Literature Review

Fadwa Yasin Flemban

Abstract


This paper aims to present a systematic literature review on empirical digital games (DG) studies. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was followed as a standard systematic literature review methodology. Twenty-five research papers were included in this review to determine the attributes of DGs that differently influenced learners’ cognition, attitude and behaviour. It shows also how researchers of the included studies measured participants’ progress whether during or after playing educational games. Based on the categories established and the analysis, the findings suggest that some features of games have affected diverse learning outcomes. There are also different ways of assessing the players’ learning progress while playing a game which can be summarised in three methods: by using the feedback system in the game, analysing players’ log file data, or applying external pre-tests and post-tests. This systematic review offers a helpful guideline for designing an effective educational game by considering games’ attributes with different learning subjects and outcomes. Furthermore, it extends the guidance by providing a general list of how educators have assessed students’ progress after playing an educational game. Thus, combining game attributes to attain specific learning outcomes and assessment methods to measure players’ progress is a specific purpose of this paper. Recommendations for future research and for practice are provided as well as the paper’s limitations.

https://doi.org/10.26803/ijlter.23.1.22


Keywords


assessing learning progress; learning outcomes; digital game attributes; playing games; effective educational game

Full Text:

PDF

References


Adam, S. (2006). An introduction to learning outcomes. https://pedagogie-universitaire.blogs.usj.edu.lb/wp-content/blogs.dir/43/files/2013/03/An-introduction-of-learning-outcomes.pdf

Alessi, S. M., & Trollip, S. R. (2001). Multimedia for learning: Methods and development (3rd ed.). Allyn & Bacon.

Baker, E. L., & Delacruz, G. C. (2008). A framework for the assessment of learning games. In O’Neil, H., & Perez, R. (Eds.), Computer games and team and individual learning. Elsevier.

Barz, N., Benick, M., Dörrenbächer-Ulrich, L., & Perels, F. (2023). The effect of digital game-based learning interventions on cognitive, metacognitive, and affective-motivational learning outcomes in school: A meta-analysis. Review of Educational Research, 0(0). https://doi.org/10.3102/00346543231167795

Belland, B. R. (2012). The role of construct definition in the creation of formative assessment in game-based learning. In Ifenthaler, D., Eseryel, D., & Ge, X. (Eds.), Assessment in Game-Based Learning: Foundations Innovations, and Perspectives (pp. 29–40). Springer. https://doi.org/10.1007/978-1-4614-3546-4_3

Ben-Zadok, G., Leiba, M., & Nachmias, R. (2011). Drills, games or tests? Evaluating students’ motivation in different online learning activities, using log file analysis. Interdisciplinary Journal of E-Learning and Learning Objects, 7, 235-248. https://doi.org/10.28945/1522

Chang, M., Evans, M. A., Kim, S., Norton, A., & Samur, Y. (2015). Differential effects of learning games on mathematics proficiency. Educational Media International, 52(1), 47–57. https://doi.org/10.1080/09523987.2015.1005427

Chen, S. W., Yang, C. H., Huang, K. S., & Fu, S. L. (2019). Digital games for learning energy conservation: A study of impacts on motivation, attention, and learning outcomes. Innovations in Education and Teaching International, 56(1), 66–76. https://doi.org/10.1080/14703297.2017.1348960

Cheon, C., Chung, S., & Lee, S. (2015). The roles of attitudinal perceptions and cognitive achievements in a serious game. Journal of Educational Computing Research, 52(1), 3-25. https://doi.org/10.1177/0735633114568851

Erhel, S., & Jamet, E. (2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156–167. https://doi.org/10.1016/j.compedu.2013.02.019

Feng, X., & Yamada, M. (2019). Effects of game-based learning on informal historical learning: A learning analytics approach. Proceedings of the 27th International Conference on Computers in Education. Taiwan: Asia-Pacific Society for Computers in Education.

Fishman, B., Riconscente, M., Snider, R., Tsai, T., & Plass, J. (2015). Empowering educators: Supporting student progress in the classroom with digital games (Part 2). Ann Arbor: University of Michigan. http://gamesandlearning.umich.edu/wp-content/uploads/2015/02/A-GAMES-Part-II_Case-Studies.pdf

Fokides, E. (2018). Digital educational games and mathematics. Results of a case study in primary school settings. Education and Information Technologies, 23, 851–867. https://doi.org/10.1007/s10639-017-9639-5

Gao, J. B., Yang, Y. T. C., & Chen, I. H. (2009). How digital game-based learning can improve students’ academic achievement and problem solving. In Bastiaens, T., Dron, J., & Xin, C. (Eds.), Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2009 (pp. 1256–1263). Vancouver, Canada: Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/primary/p/32627/

Guillén-Nieto, V., & Aleson-Carbonell, M. (2012). Serious games and learning effectiveness: The case of It’s a Deal!. Computers & Education, 58(1), 435–448. https://doi.org/10.1016/j.compedu.2011.07.015

Halverson, R., & Owen, V. E. (2014). Game-based assessment: An integrated model for capturing evidence of learning in play. International Journal of Learning Technology, 9(2), 111–138. https://doi.org/10.1504/ijlt.2014.064489

Holmes, V. (2015). The effect of the new digital energy game on students’ interest, attitude, and science achievement using propensity score matching, 2014–2015. Research Educational Program Report. Houston Independent School District.

Homer, B. D., Plass, J. L., Raffaele, C., Ober, T. M., & Ali, A. (2018). Improving high school students’ executive functions through digital game play. Computers & Education, 117, 50–58. https://doi.org/10.1016/j.compedu.2017.09.011

Horton, W. (2012). E-learning by design (2nd ed.). Wiley.

Hou, H., & Li, M. (2014). Evaluating multiple aspects of a digital educational problem-solving-based adventure game. Computers in Human Behavior, 30, 29–38. http://doi.org/10.1016/j.chb.2013.07.052

Huang, Z., & Cappel, J. J. (2005). Assessment of a web-based learning game in an information systems course. Journal of Computer Information Systems, 45(4), 42–49. http://doi.org/10.1080/08874417.2005.11645854

Ke, F. (2008). A case study of computer gaming for math: Engaged learning from gameplay? Computers & Education, 51, 1609–1620. http://doi.org/10.1016/j.compedu.2008.03.003

Klassen, K., & Willoughby, K. (2003). In-class simulation games: Assessing student learning. Journal of Information Technology Education: Research, 2(1), 1–13. https://doi.org/10.28945/306

Klisch, Y., Miller, L. M., Wang, S., & Epstein, J. (2011). The impact of a science education game on students’ learning and perception of inhalants as body pollutants. Journal of Science Education and Technology, 21, 295–303. http://doi.org/10.1007/s10956-011-9319-y

Korte, M. (2022). The impact of the digital revolution on human brain and behavior: where do we stand?. Dialogues in Clinical Neuroscience, 22(2), 101-111, http://doi.org/10.31887/DCNS.2020.22.2/mkorte

Kubiszyn, T., & Borich, G. (2010). Educational testing and measurement: Classroom application and practice (9th ed.). John Wiley & Sons.

Lauer, P. A., Akiba, M., Wilkerson, S. B., Apthorp, H. S., Snow, D., & Martin-Glenn, M. L. (2006). Out-of-school-time programs: A meta-analysis of effects for at-risk students. Review of Educational Research, 76(2), 275–313. https://doi.org/10.3102/00346543076002275

Lee, C., & Chen, M. (2009). A computer game as a context for non-routine mathematical problem solving: The effects of type of question prompt and level of prior knowledge. Computers & Education, 52, 530–542. http://doi.org/10.1016/j.compedu.2008.10.008

Martin, M. W., & Shen, Y. (2014) The effects of game design on learning outcomes, computers in the schools. Interdisciplinary Journal of Practice, Theory, and Applied Research, 31(1–2), 23–42. http://doi.org/10.1080/07380569.2014.879684

Miller, W. L., Baker, R. S., & Rossi, L. M. (2014). Unifying computer-based assessment across conceptual instruction, problem-solving, and digital games. Technology, Knowledge and Learning, 19, 165-181. https://doi.org/10.1007/s10758-014-9225-5

Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). Focus article: On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1(1), 3–62. https://doi.org/10.1207/s15366359mea0101_02

Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. International Journal of Surgery, 8(5), 336-341. http://doi.org/10.1371/journal.pmed1000097

O’Neil, H., Chung, G., Kerr, D., Vendlinski, T., Buschang, R., & Mayer, R. (2014). Adding self-explanation prompts to an educational computer game. Computers in Human Behavior, 30, 23–28. https://doi.org/10.1016/j.chb.2013.07.025

Owen, V. E., Ramirez, D., Salmon, A., & Halverson, R. (2014). Capturing learner trajectories in educational games through ADAGE (Assessment data aggregator for game environments): A click-stream data framework for assessment of learning in play [Paper presentation]. The 2014 American Educational Research Association Annual Meeting, Philadelphia, PA, United States.

Papastergiou, M. (2008). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1–12.

Prensky, M. (2001). Digital game-based learning. The games generations: How learners have changed). McGraw-Hill.

Schrader, C., & Bastiaens, T. (2012). Learning in educational computer games for novices: The impact of support provision types on virtual presence, cognitive load, and learning outcomes. The ?nternational Review of Research in Open and Distance Learning, 13(3), 206–227. https://doi.org/10.19173/irrodl.v13i3.1166

Shute, V. J. & Ke, F. (2012). Games, learning, and assessment. In Ifenthaler, D., Eseryel, D., & Ge, X. (Eds.), Assessment in Game-Based Learning: Foundations Innovations, and Perspectives (pp. 43–58). Springer. http://doi.org/10.1007/978-1-4614-3546-4_4

Shute, V. J., Ventura, M., Bauer, M., & Zapata?Rivera, D. (2008). Monitoring and fostering learning through games and embedded assessments. ETS Research Report Series. https://doi.org/10.1002/j.2333-8504.2008.tb02155.x

Spires, H. A., Rowe, J. P., Mott, B. W., & Lester, J. C. (2011). Problem solving and game-based learning: Effects of middle grade students’ hypothesis testing strategies on learning outcomes. Journal of Educational Computing Research, 44(4), 453–472. https://doi.org/10.2190/ec.44.4.e

Tsai, F., Tsai, C., & Lin, K. (2015). The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment. Computers & Education, 81, 259–269. http://doi.org/10.1016/j.compedu.2014.10.013

Udeozor, C., Toyoda, R., Russo Abegão, F., & Glassey, J. (2023). Digital games in engineering education: systematic review and future trends. European Journal of Engineering Education, 48(2), 321-339. https://doi.org/10.1080/03043797.2022.2093168

Whitton, N. (2014). Digital games and learning: Research and theory. Routledge.

Ye?ilta?, E., & Cevher, R. A. S. (2022). Trends in Research on the Use of Digital Games in Education. E-International Journal of Educational Research, 13(4). 40-56. https://doi.org/10.19160/e-ijer.1107500


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493