Can Student Engagement in Online Courses Predict Performance on Online Knowledge Surveys?

Bernard Bahati, Fors Uno, Matti Tedre

Abstract


The link between student engagement and academic performance has been widely examined. However, most of these studies have focused on ascertaining the existence of such a relationship on the summative assessment level. By comparing students’ experience points in an online course and students’ scores on online knowledge surveys (KS), this study examined the relationship between student engagement and performance on online KS on the formative assessment level. Knowledge surveys were developed and formatively administered in four sections of an online Integration of ICT in Education course. Using Moodle Feedback Module, knowledge surveys were designed based on three key elements: learning objectives, the course content, and the revised Bloom’s Taxonomy of learning objectives. Using rated multiple choice KS questions, the correlation between students’ scores on KSs and students’ experience points was calculated using SPSS. The results show that students’ confidence levels in ability to answer KS questions increased in some of the course sections and decreased in others.  The student engagement in online course was positively—but weakly—related to student performance on online KS and the strength of this relationship increased as the course unfolded. Our conclusion is that student engagement in online courses would not be an accurate predictor of student performance on online Knowledge surveys right at the beginning of an instructional process.


Keywords


Formative e-assessment, knowledge survey, student engagement

Full Text:

PDF

References


Bahati, B., Tedre, M., Fors, U., & Evode, M. (2016). Exploring feedback practices in formative assessment in Rwandan Higher Education: A multifaceted approach is needed. International Journal of Teaching and Education, 4(2), 1–22.

Baumgart, S., & Hassemer, E. (2008). Online knowledge surveys as a means of library instruction assessment. In Moving targets: Understanding our changing landscapes: Thirty-fourth national loex library instruction conference proceedings.

Bell, P., & Volckmann, D. (2011). Knowledge surveys in general chemistry: confidence, overconfidence, and performance. Journal of Chemical Education, 88(11), 1469–1476.

Bertheussen, B. A., & Myrland, Ø. (2016). Relation between academic performance and students’ engagement in digital learning activities. Journal of Education for Business, 91(3), 125–131.

Bourne, J., & Moore, J. (2003). Elements of quality online education: Practice and direction. Sloan Consortium. Retrieved from https://books.google.rw/books? id=QenE7KrzS14C

Bowers, N., Brandon, M., & Hill, C. D. (2005). The use of a knowledge survey as an indicator of student learning in an introductory biology course. Cell biology education, 4(4), 311–322.

Bransford, J. D., Brown, A. L., & Cocking, R. R. (1999). How people learn: Brain, mind, experience, and school. National Academy Press.

Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: Testing the linkages. Research in higher education, 47(1), 1–32.

Carroll, J. M. (2009). Learning in communities: interdisciplinary perspectives on human centered information technology. Springer Science & Business Media.

Chang, S.-H. H., & Smith, R. A. (2008). Effectiveness of personal interaction in a learner-centered paradigm distance education class based on student satisfaction. Journal of Research on Technology in Education, 40(4), 407–426.

Christenson, S., Reschly, A., & WYLIE, C. (2012). Handbook of research on student engagement. Springer.

Dunne, E. (2013). The student engagement handbook: Practice in higher education. Emerald Group Publishing Limited. Retrieved from https://books.google.rw/ books? id=COB5AgAAQBAJ.

Earle, R. S. (2002). The integration of instructional technology into public education: Promises and challenges. EDUCATIONAL TECHNOLOGY-SADDLE BROOK THEN ENGLEWOOD CLIFFS NJ-, 42(1), 5–13.

Ehrlinger, J., Mitchum, A. L., & Dweck, C. S. (2016). Understanding overconfidence: Theories of intelligence, preferential attention, and distorted self-assessment. Journal of Experimental Social Psychology, 63, 94-100.

Favazzo, L., Willford, J. D., & Watson, R. M. (2014). Correlating student knowledge and confidence using a graded knowledge survey to assess student learning in a general microbiology classroom. Journal of microbiology & biology education, 15(2), 251.

Forsberg, E., Ziegert, K., Hult, H., & Fors, U. (2016). Assessing progression of clinical reasoning through virtual patients: An exploratory study. Nurse education in practice, 16(1), 97–103.

Grove, S. K., Burns, N., & Gray, J. R. (2014). Understanding nursing research: Building an evidence-based practice. Elsevier Health Sciences.

GUNUC, S. (2014). The relationships between student engagement and their academic achievement. International Journal on New Trends in Education and Their Implications, 5(4), 216–231.

Gutierrez, K. (2014). The eLearning dilemma: Engaged vs unengaged learners. Retrieved from http://goo.gl/oajkoc.

Henrie, C. R., Bodily, R., Manwaring, K. C., & Graham, C. R. (2015). Exploring intensive longitudinal measures of student engagement in blended learning. The International Review of Research in Open and Distributed Learning, 16(3).

Hillman, D. C. A., Willis, D. J., & Gunawardena, C. N. (1994). Learner-interface interaction in distance education: An extension of contemporary models and strategies for practitioners. American Journal of Distance Education, 8(2), 30- 42. Retrieved from http://dx.doi.org/10.1080/08923649409526853 doi: 10 .1080/08923649409526853.

Hiltz, S. R. (2005). Building learning communities in online courses. In Web based communities 2005, proceedings of the IADIS international conference on web-based communities.

Johnson, I. (2017). Female Faculty Role Models, Self-Efficacy and Student Achievement. College Student Journal, 51(1), 151-172.

Johnson-Smith, T. R. (2014). Student engagement and academic achievement in technology enhanced and traditional classroom environments (Unpublished doctoral dissertation). Liberty University.

King, P. M., & Kitchener, K. S. (1994). Developing reflective judgment: Understanding and promoting intellectual growth and critical thinking in adolescents and adults. Jossey-bass higher and adult education series and Jossey-bass social and behavioral science series. ERIC.

Kitao, S. K., & Kitao, K. (2013). Apologies, apology strategies, and apology forms for non-apologies in a spoken corpus. Journal of culture and information science, 8(2), 1–13.

Krathwohl, D. R. (2002). A revision of bloom’s taxonomy: An overview. Theory into practice, 41(4), 212–218.

Kuh, G. D. (2009). The national survey of student engagement: Conceptual and empirical foundations. New directions for institutional research, 2009(141), 5–20.

Kushwaha, R. C., Singhal, A., & Chaurasia, P. K. (2015). Study of student’ performance in learning management system. International Journal of Contemporary Research in Computer Science and Technology (IJCRCST), 1(6), 213–217.

Li, Y., Bebiroglu, N., Phelps, E., Lerner, R., & Lerner, J. (2008). Out-of-school time activity participation, school engagement and positive youth development: Findings from the 4-h study of positive youth development. Journal of Youth Development, 3(3), 8–21.

Mac Giolla Phadraig, C., Ho, J.D., Guerin, S., Yeoh, Y.L., Mohamed Medhat, M., Doody, K., Hwang, S., Hania, M., Boggs, S., Nolan, A. and Nunn, J. (2016). Neither Basic Life Support knowledge nor selfâ€efficacy are predictive of skills among dental students. European Journal of Dental Education.

McClenney, K., Marti, C. N., & Adkins, C. (2012). Student engagement and student outcomes: Key findings from. Community College Survey of Student Engagement.

Miller, T. M., & Geraci, L. (2011). Unskilled but aware: reinterpreting overconfidence in low-performing students. Journal of experimental psychology: learning, memory, and cognition, 37(2), 502.

Moore. (1989). Editorial: Three types of interaction. American Journal of Distance Education, 3(2), 1-7. doi: 10.1080/08923648909526659

Moore, J. (2014). Effects of online interaction and instructor presence on students’ satisfaction and success with online undergraduate public relations courses. Journalism & Mass Communication Educator, 69(3), 271–288.

Mugisha, I. S. (2010). Assessment and study strategies: A study among Rwandan

students in higher education (Unpublished doctoral dissertation). Linköping

University Electronic Press.

Ngendahayo, E. (2014). Rethinking Rwandan higher education assessment system and approaches. Rwandan Journal of Education, 2(2), 31–47.

Ngendahayo, E., & Askell-Williams, H. (2016). Rwanda’s new competence-based school curriculum. In Publishing, higher degree research (pp. 155–165). Springer.

Nilson, L. (2013). Creating self-regulated learners: Strategies to strengthen students? self-awareness and learning skills. Stylus Publishing, LLC.

Nuhfer, E., & Knipp, D. (2003). The knowledge survey: A tool for all reasons. To improve the academy, 21, 59–78.

Pantziaras, I., Fors, U., & Ekblad, S. (2015). Innovative training with virtual patients in transcultural psychiatry: The impact on resident psychiatrists’ confidence. PloS one, 10(3), e0119754.

Pascarella, E., & Terenzini, P. (2005). How college affects students: A third decade of research. Wiley. Retrieved from https://books.google.rw/books?id= Wn8kAQAAMAAJ

Rodgers, T. (2008). Student engagement in the e-learning process and the impact on their grades. International Journal of Cyber Society and Education, 1(2), 143–156.

Sage research methods online [electronic resource]. (2011). [London]: SAGE Publications.

Salkind, N. J. (2010). Encyclopedia of research design (Vol. 1). Sage.

Shea-Schultz, H., & Fogarty, J. (2002). Online learning today: Strategies that work. Berrett-Koehler Publishers.

Sieck, W. R., Merkle, E. C., & Van Zandt, T. (2007). Option fixation: A cognitive contributor to overconfidence. Organizational Behavior and Human Decision Processes, 103(1), 68–83.

Smith, I. (2014). Assessment & learning pocketbook. Management Pocketbooks.

Stankov, L., Morony, S., & Lee, Y. P. (2014). Confidence: the best non-cognitive predictor of academic achievement? Educational Psychology, 34(1), 9–28.

Trowler, V. (2010). Student engagement literature review. The Higher Education Academy, 11, 1–15.

Villafañe, S. M., Xu, X., & Raker, J. R. (2016). Self-efficacy and academic performance in first-semester organic chemistry: testing a model of reciprocal causation. Chemistry Education Research and Practice, 17(4), 973-984.

Wirth, K. R., & Perkins, D. (2005). Knowledge surveys: An indispensable course design and assessment tool. Innovations in the Scholarship of Teaching and Learning.

Wong, L. (2013). Student engagement with online resources and its impact on learning outcomes. Journal of Information Technology Education, 12.

Zimmerman, T. D. (2012). Exploring learner to content interaction as a success factor in online courses. The International Review of Research in Open and Distributed Learning, 13(4), 152–165.


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493