Archives

A Reliability of Multirater Approach on Lecturer Performance Evaluation


Sukirno
Abstract

Purpose: In supporting a national higher education policy, lecturers in Indonesia are now demanded performing better in teaching, research, publications, and social services. Multiapproaches of lecturer performance measurement are now adopted and evaluated their functionalities. Nevertheless, no study was found explaining the reliability of the approaches. This research was aimed to expose a reliability issue of a multirater approach on lecturer performance in higher education institutions in Indonesia. Method: A closed ended questionnaires with a five-point scale were distributed to lecturers and students in public and private universities in Indonesia. About 347 questionnaires finally could be further analysed with descriptive presentation, t-test, and Anova test. Findings: This research found no significant different rating pattern among raters. It implies that inter-rater reliability and inter-rater agreement are coexisted and further there is no difference perception of lecturer perfomance between raters. Nevertheless, rating on lecturer performance varies among three raters based on demograpics data. It might be affected by different gender types, ages, experiences, and school backgrounds. Implications for Research and Practice: The research findings are discussed and recommendations are proposed for education policy makers and researchers to provide a better valid lecturer performance measurement instruments in order inter-rater reliability and agreement are reached to facilitate a better quality of decision making.

Volume 12 | 08-Special Issue

Pages: 651-658

DOI: 10.5373/JARDCS/V12SP8/20202567