The Agreement and Structure of Colleague Ratings

Abstract

The interrater reliability and the factor structure of colleague ratings of university faculty were studied. Two approaches to rating colleagues were compared: a global rating and an analytic rating in four areas of responsibility. Reliability indices indicated that means based on four raters using the analytic method were reliable. Results of a factor analysis indicated the presence of two factors: research and publications and, to a lesser extent, teaching.