Decision-making by Heads of Academic Department using Student Evaluation of Instruction (SEI)
Abstract
This study investigates the ways in which heads of academic department use student evaluation of instruction (SEI) to make decisions about individual faculty members and/or whole academic departments. The study utilized a convenience sample of 57 heads of department, who completed an online questionnaire with two main constructs, which were assessed at the interval level of measurement. The results of the study revealed significant differences between heads of department who tend to trust SEI results compared to those who tend not to trust SEI results. The findings suggest there is a significant association between how heads of department perceive SEI and how they use it to make decisions about individual faculty members and their academic departments. In addition, analysis of the respondents as per two groups, according to their attitudes of trust or distrust toward SEI, showed that disparities within these groups were greater with respect to issues or decisions that affect individuals as opposed to whole departments. Therefore, the study concludes that decisions should not be made based solely on the results of SEI; rather, multiple sources of evaluation should be utilized to make proper decisions. The author strongly recommends that academic leaders should use SEI across multiple years or courses in order to obtain more reliable information. Future research may include qualitative studies on the topic and discipline-specific studies within certain academic departments or college clusters.
https://doi.org/10.26803/ijlter.20.2.13
Keywords
Full Text:
PDFReferences
Alderman, L., Towers, S., & Bannah, S. (2012). Student feedback systems in higher education: A focused literature review and environmental scan. Quality in Higher Education, 18(3), 261-280. https://doi.org/10.1080/13538322.2012.730714
Aleamoni, L. M. (1999). Student rating myths versus research facts from 1924 to 1998. Journal of Personnel Evaluation in Education, 13, 152-66. https://doi.org/10.1023/A:1008168421283
Algozzine, B., Gretes, J., Flowers, C., Howley, L., Beattie, J., Spooner, F., Mohanty, G., & Bray, M. (2004). Student evaluation of college teaching: A practice in search of principles. College Teaching, 52(4), 134 41. https://doi.org/10.3200/CTCH.52.4.134-141
Alkathiri, M. S. (2018). Using art-based techniques in faculty training programmes. In T. Chemi & X. Du (Eds.), Palgrave studies in business, arts and humanities: Arts-based methods and organizational learning (pp. 265–290). Palgrave Macmillan. https://doi.org/10.1007/978-3-319-63808-9_12
Alkathiri, M. S. (2020). Teaching and learning experiences of college students in Saudi higher education in the 21st century. The International Journal of Learning in Higher Education, 27(1), 15-30. https://doi.org/10.18848/2327-7955/CGP/v27i01/15-30
Arthur, L. (2009). From performativity to professionalism: Lecturers’ responses to student feedback. Teaching in Higher Education, 14(4), 441 454. https://doi.org/10.1080/13562510903050228
Badri, M., Abdulla, M., Kamali, M., & Dodeen, H. (2006). Identifying potential biasing variables in student evaluation of teaching in a newly accredited business program in the UAE. International Journal of Educational Management, 20, 43-59. https://doi.org/10.1108/09513540610639585
Basow, S. (1995). Student evaluations of college professors: When gender matters. Journal of Educational Psychology, 87, 656-665. https://doi.org/10.1037/0022-0663.87.4.656
Buchert, S., Laws, E. L., Apperson, J. M., & Bregman, N. J. (2008). First impressions and professor reputation: Influence on student evaluations of instruction. Social Psychology of Education, 11(4), 397-408. https://doi.org/10.1007/s11218-008-9055 1
Carle, A. C. (2009). Evaluating college students’ evaluations of a professor’s teaching effectiveness across time and instruction mode (online vs. face-to-face) using a multilevel growth modeling approach. Computers & Education, 53(2), 429 435. https://doi.org/10.1016/j.compedu.2009.03.001
Cashin, W. E. (2003). Evaluating college and university teaching: Reflections of a practitioner. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (pp. 531–593). Kluwer Academic. https://doi.org/10.1007/978-94-010-0137-3_10
Centra, J. A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. Jossey-Bass. https://eric.ed.gov/?id=ED363233
Centra, J. A., & Gaubatz, N. B. (2000). Is there gender bias in student evaluations of teaching? Journal of Higher Education, 70(1), 17-33. https://doi.org/10.1080/00221546.2000.11780814
Chamberlin, M. S., & Hickey, J. S. (2001). Student evaluations of faculty performance: The role of gender expectations in differential evaluations. Educational Research Quarterly, 25(2), 3-14. https://search.proquest.com/docview/216185804?pq-origsite=gscholar&fromopenview=true
Delvaux, E., Vanhoof, J., Tuytens, M., Vekeman, E., Devos, G., & Van Petegem, P. (2013). How may teacher evaluation have an impact on professional development? A multilevel analysis. Teaching and Teacher Education Journal, 36, 1-11. https://doi.org/10.1016/j.tate.2013.06.011
Emery, C. R., Kramer, T. R., & Tian, R. G. (2003). Return to academic standards: A critique of students’ evaluations of teaching effectiveness. Quality Assurance in Education: An International Perspective, 11(1), 37-47. https://doi.org/10.1108/09684880310462074
Freeman Jr., S., Karkouti, I. M., & Ward, K. (2020). Thriving in the midst of liminality: Perspectives from department chairs in the USA. Higher Education, 80, 895-911. https://doi.org/10.1007/s10734-020-00521-6
Hendry, G. D., & Dean, S. J. (2002). Accountability, evaluation of teaching and expertise in higher education. The International Journal for Academic Development, 26(4), 327 414. https://doi.org/10.1080/13601440210156493
Kelly, H. F., Ponton, M. K., & Rovai, A. P. (2007). A comparison of student evaluations of teaching between online and face-to-face courses. Internet and Higher Education, 10, 89-101. https://doi.org/10.1016/j.iheduc.2007.02.001
Landrum, R. E., & Braitman, K. A. (2008). The effect of decreasing response options on students’ evaluation of instruction. College Teaching, 56, 215 217. https://doi.org/10.3200/CTCH.56.4.215-218
Liaw, S., & Goh, K. (2003). Evidence and control of biases in student evaluations of teaching. The International Journal of Educational Management, 17(1), 37 43. https://doi.org/10.1108/09513540310456383
Liu, O. L. (2012). Student evaluation of instruction: In the new paradigm of distance education. Research in Higher Education, 53, 471-486. https://doi.org/10.1007/s11162-011-9236-1
Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education (pp. 319–383). Springer. https://doi.org/10.1007/1-4020-5742-3_9
Marsh, H. W., & Roche, L. A. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52(11), 1187-1197. https://doi.org/10.1037/0003-066X.52.11.1187
Marsh, H. W., & Roche, L. A. (2000). Effects of grading lenience and low workload on students’ evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92(1), 202-228. https://doi.org/10.1037/0022-0663.92.1.202
Massy, W. F., & French, N. J. (2001). Teaching and learning quality process review: What the programme has achieved in Hong Kong. Quality in Higher Education, 1, 34-45. https://doi.org/10.1080/13538320120045067
McGhee, D. E., & Lowell, N. (2003). Psychometric properties of student ratings of instruction in online and on-campus courses. New Directions for Teaching & Learning, 96, 39-48. https://doi.org/10.1002/tl.121
McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52, 1218-1225. https://doi.org/10.1037/0003-066X.52.11.1218
Muammar, O. M., & Alkathiri, M. S. (2021). What really matters to faculty members attending professional development programs in higher education. International Journal for Academic Development. https://doi.org/10.1080/1360144X.2021.1897987
Nasser, F., & Fresko, B. (2002). Faculty views of student evaluation of college teaching. Assessment & Evaluation in Higher Education, 27(2), 187 198. https://doi.org/10.1080/02602930220128751
Obenchain, K. M., Abernathy, T. V., & Wiest, L. R. (2001). The reliability of students’ ratings of faculty teaching effectiveness. College Teaching, 49(3), 100-104. https://doi.org/10.1080/87567550109595859
Perry, R. P., & Smart, J. C. (Eds.). (2007). The scholarship of teaching and learning in higher education: An evidence-based perspective. Springer. https://doi.org/10.1007/1-4020-5742-3
Radmacher, S. A., & Martin, D. J. (2001). Identifying significant predictors of student evaluations of faculty through hierarchical regression analysis. The Journal of Psychology, 135(3), 259-268. https://doi.org/10.1080/00223980109603696
Reznik, S. D., & Sazykina, O. A. (2017). Head of a university department: Competence and new activity priorities. European Journal of Contemporary Education, 6(1), 126-137. https://doi.org/10.13187/ejced.2017.1.126
Richardson, J. T. E. (2005). Instruments for obtaining student feedback: A review of the literature. Assessment and Evaluation in Higher Education, 30(4), 387-415. https://doi.org/10.1080/02602930500099193
Rovai, A. P., Ponton, M. K., Derrick, M. G., & Davis, J. M. (2006). Student evaluation of teaching in the virtual and traditional classrooms: A comparative analysis. Internet and Higher Education, 9, 23-35. https://doi.org/10.1016/j.iheduc.2005.11.002
Scott, G., & Hawke, I. (2003). Using an external quality audit as a lever for institutional change. Assessment and Evaluation in Higher Education, 28(3), 323-332. https://doi.org/10.1080/0260293032000059667
Seldin, P. (1999). Current practices—good and bad—nationally. In P. Seldin & Associates (Eds.), Changing practices in evaluating teaching: A practical guide to improved faculty performance and promotion/tenure decisions (pp. 1–24). Anker. https://www.wiley.com/en-sa/Changing+Practices+in+Evaluating+Teaching:+A+Practical+Guide+to+Improved+Faculty+Performance+and+Promotion+Tenure+Decisions-p-9781882982288
Shah, M., & Nair, C. S. (2012). The changing nature of teaching and unit evaluations in Australian universities. Quality Assurance in Education, 20(3), 274-288. https://doi.org/10.1108/09684881211240321
Smith, R. (2005). Departmental leadership and management in chartered and statutory universities. Educational Management Administration & Leadership, 33(4), 449-464. https://doi.org/10.1177/1741143205056305
Spooren, P., Mortelmans, D., & Denekens, J. (2007). Student evaluation of teaching quality in higher education: Development of an instrument based on 10 Likert-scales. Assessment & Evaluation in Higher Education Journal, 32(6), 667-679. https://doi.org/10.1080/02602930601117191
Taherdoost, H. (2016). Sampling methods in research methodology: How to choose a sampling technique for research. International Journal of Advance Research in Management, 5(2), 18-27. https://doi.org/10.2139/ssrn.3205035
Theall, M., & Franklin, J. (2001). Looking for bias in all the wrong places: A search for truth or a witch hunt in student ratings of instruction? In M. Theall, P. C. Abrami, & L. A. Mets (Eds.), The student ratings debate: Are they valid? How can we best use them? [Special issue of New Directions for Institutional Research, 2001(109), 45-56. https://doi.org/10.1002/ir.3] Wiley.
Tucker, B. M. (2015). The student voice: Using student feedback to inform quality in higher education (Doctoral dissertation). Curtin University, Perth. https://espace.curtin.edu.au/bitstream/handle/20.500.11937/2158/234289_Tucker%20B%202015.pdf
Tucker, B. (2014). Student evaluation surveys: Anonymous comments that offend or are unprofessional. Higher Education, 68(3), 347-358. https://doi.org/10.1007/s10734-014-9716-2
Wachtel, H. K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment & Evaluation in Higher Education, 23(2), 191-212. https://doi.org/10.1080/0260293980230207
Waschull, S. B. (2001). The online delivery of psychology courses: Attrition, performance, and evaluation. Computers in Teaching, 28, 143-147. https://doi.org/10.1207/S15328023TOP2802_15
Whitworth, J., Price, B., & Randall, C. (2002). Factors that affect college of business student opinion of teaching and learning. Journal of Education for Business, 77, 282-289. https://doi.org/10.1080/08832320209599677
Zhao, J., & Gallant, D. J. (2012). Student evaluation of instruction in higher education: Exploring issues of validity and reliability. Assessment and Evaluation in Higher Education, 37, 227-235. https://doi.org/10.1080/02602938.2010.523819
Zineldin, M., Akdag, H. C., & Vasicheva, V. (2011). Assessing quality in higher education: New criteria for evaluating students’ satisfaction. Quality in Higher Education Journal, 17(2), 231-243. https://doi.org/10.1080/13538322.2011.582796
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493