magazinelogo

The Educational Review, USA

ISSN Print: 2575-7938 Downloads: 491505 Total View: 5092337
Frequency: monthly ISSN Online: 2575-7946 CODEN: TERUBB
Email: edu@hillpublisher.com
Article Open Access http://dx.doi.org/10.26855/er.2022.11.005

A Study of the Relationship between Different Evaluators and Principals’ Leadership Effectiveness Evaluation in Feedback System

Tsai-Feng Cheng1, Huei-Chun Wu2, Lu-Wen Chiu3, Lung-An Shen4,*

1Distinguished Professor in the Department of Education, National Kaohsiung Normal University, Taiwan.

2Office of General Affairs, Director of Property Management Division, Kaohsiung Medical University, Taiwan.

3Principal of Kaohsiung Municupal Mi-Tuo Junior High School, Taiwan.

4Assistant Professor in the Center for Teacher Education, Cheng Shiu University, Taiwan.

*Corresponding author: Lung-An Shen

Published: December 23,2022

Abstract

This study aimed to discuss the difference of different evaluators in principals’ leadership effectiveness evaluation, analyze the difference between self-evaluators and the other evaluators in principals’ leadership effectiveness evaluation; investigate principals’ perception of the difference between different evaluators’ leadership effectiveness evaluation capacity; and explore the relationship between principals’ perception of evaluators’ capacity, principals’ attitudes toward evaluation feedback system, and principals’ attitudes toward evaluation feedback results. The conclusions of this study were as follows: The score given by educational administrators in elementary school principals’ leadership effectiveness evaluation was the lowest; the score given by principals themselves in leadership effectiveness evaluation was higher than the scores given by the others; principals thought that educational administrators’ evaluation capacity was the lowest; principals’ acceptability of 360 degree evaluation was higher than the equity of the system and the equity of results; and evaluators’ capacity and principals’ attitudes toward evaluation feedback were highly correlated.

References

Alammar, L. (2015).  The effective school: The role of the leaders in school effectiveness.  Educational Research and Reviews, 10(6), 695-721. 

Amundsen, S., & Martinsen, L. (2014).  Self–other agreement in empowering leadership: Relationships with leader effectiveness and subordinates' job satisfaction and turnover intention.  Leadership Quarterly, 25(4), 784-800. 

Atwater, L., & Waldman, D. (1998).  360 Degree feedback and leadership development.  Leadership Quarterly, 9(4), 423-427. 

Atwater, L., & Yammarino, F. (1997).  Self- other rating agreement: A review and model.  Research in Personnel and Human Resource Management, 15, 121-174. 

Bass, B. M. (1990).  Handbook of leadership: Theory research and managerial applications. (3rd ed.).  New York, NY: Simon and Schuster. 

Bergner, S., Davda, A., Culpin, V., & Rybnicek, R. (2016).  Who overrates, who underrates?  Personality and its link to self–other agreement of leadership effectiveness.  Journal of Leadership & Organizational Studies, 23(3), 335-354. 

Bernardin, H. J., & Klatt, L. A. (1985).  Managerial appraisal systems: Has practice caught up to the state of the art?  Personnel Administrator, 30, 79-86. 

Bernardin, H. J., Dahmus, S. A., & Redmon, G.(1993).  Attitudes of first-line supervisors toward subordinate appraisals.  Human Resource Management, 32, 315-324. 

Bracken, D. W., & Church, A. H. (2013).  The "new" performance management paradigm: Capitalizing on the unrealized potential of 360 degree feedback.  People & Strategy, 36(2), 34-40. 

Bracken, D. W., & Rose, D.S. (2011).  When does 360-degree feedback create behavior change?  And how would we know it when it does?  Journal Business Psychology, 26, 183-192. 

Brett J, F., & Atwater, L. E. (2001).  360 feedback: A ccuracy, reactions, and perceptions of usefulness.  Journal of Applied Psychology, 86, 930-942. 

Brown, A., Lin, Y., & Inceoglu, I. (2017).  Preventing rater biases in 360-degree feedback by forcing choice.  Organizational Research Methods, 20(1), 121-148. 

Cameron, K. S., & Quinn, R. E. (1999).  Diagnosing and changing organizational culture.  Addison-Wesley. 

Cardy, L. R., & Dobbins, H.G. (1994).  Performance appraisal: Alter- native perspectives.  Cinicinnati: South-Western. 

Cheng, T. F. (2007).  A study on school principals’ competing values leadership effectiveness: Theory, indicator and assessment.  Taipei: Higher Education. 

Cheng, T. F. (2012).  A study on the senior high vocational school principals’ competing values leadership effectiveness indicators constructed and their relationships with behavior change intention based on 360 degree evaluation system.  National Science Council (NSC 98-2511-S-017- 002-MY3). 

Cheng, T. F., & Wu, H. C. (2009). A study of the relationships among evaluations of elementary school principals’ competing values leadership effectiveness, attitudes towards 360 degree feedback and their behavior change intention.  Education Policy Forum, 12(2), 177-217. 

Cipolla, L. J. (2009).  Building performance-based 360 degree assessments: From design to delivery.  Beaver's Pond Press. 

de Vries, R. E.(2012).  Personality predictors of leadership styles and the self–other agreement problem.  Leadership Quarterly, 23(5), 809-821.  https://doi.org/10.1016/j.leaqua.2012.03.002. 

Edwards, R.M., & Ewen, J.A.(1996).  360 ° Feedback: The powerful new model for employee assessment & performance improvement.  AMACOM. 

Fleenor, J. W., & Prince, J. M. (1997).  Using 360-degree feedback in organization.  Center for creativeleadership.  Greensbolo. 

Fleenor, J., Taylor, S., & Chappelow, C. (2008).  Leveraging the impact of 360-degree feedback.  Pfeiffer. 

Frauman, T. (2013).  Augmenting effective performance management with 360degreefeedback.  Asia Pacific Coatings Journal, 26(5), 34-36. 

Furnham, A., & Stringfield, P. (1998).  Congruence in job-performance ratings: A study of 360(degree) feedback examining self, manager, peers, and consultant ratings.  Human Relations, 51, 517-530. 

Gumustekin, G. E., Ozler D. E.C., & Yilmaz, F. (2010).  A research to determining the impact of 360degree performance evaluation system on organizational commitment.  Business and Economics Research Journal, 1(1), 1-20. 

Hensel, R., Meijers, F., Leeden, R. van der. , Frans, M., & Kessels, J. (2010).  360 degree feedback: How many raters are needed for reliable ratings on the capacity to develop competences, with personal qualities as developmental goals?  International Journal of Human Resource Management, 21(15), 2813-2830.  DOI: 10.1080/09585192.2010.528664.

Johnson, J. W., & Ferstl, K. L. (1999). The effects of interreter and self-other agreement on performance improvement following upward feedback. Personnel Psychology, 52, 271-303.

Karkoulian, S., Assaker, G., & Hallak, R. (2016). An empirical study of 360-degreefeedback, organizational justice, and firm sustainability. Journal of Business Research, 69(5), 1862-1867.

Kenny, D. A., Albright, L., Malloy, T. E., & Kashy, D. A.(1994). Consensus in Interpersonal Perception: Acquaintance and the Big Five. Psychological Bulletin, 116, 245-258.

Kinicki, A. J., Prussia, G. E., Wu, B., & McKee-Ryan, F. M. (2004). A covariance structure analysis of employees’ response to performance feedback. Journal of Applied Psychology, 89(6), 1057-1069.

Kopperud, K. H., Martinsen, Ø., &Humborstad, S. I. W. (2015). Engaging leaders in the eyes of the beholder: On the relationship between transformational leadership, work engagement, service climate, and self–other agreement. Journal of Leadership & Organizational Studies, 21(1), 29-42. 

Leithwood, K., & Jantzi, D. (2008). Linking leadership to student learning: The contributions of leader efficacy. Educational Administration Quarterly, 44, 496-528.

Lepsinger, R., & Lucia, A. D. (2009). The art and science of 360 degree feedback (2nd Edition). Jossey-Bass.

London, M., & Smither, J. W. (1995). Can multi-source feedback change perceptions of goal accomplishment, self evaluations, and performance related outcomes? Theory based applications and directions for research. Personnel Psychology, 48, 803-839.

Markham, S. E., Markham, I. S., & Smith, J. W. (2015). At the crux of dyadic leadership: Self-other agreement of leaders and direct reports: Analyzing 360- degree feedback. Leadership Quarterly, 26 (6), 958-977. 

Markham, S. E., Markham, I. S., & Smith, J. W. (2017). A review, analysis, and extension of peer-leader feedback agreement: Contrasting group aggregate agreement vs. self-other agreement using entity analytics and visualization. Leadership Quarterly, 28(1), 153-177.

Maurer, T. J., & Palmer, J.K. (1999). Management development intentions following feedback: Role of perceived outcomes, social pressures, and control. Journal of Management Development, 18, 733-751.

McKee, R. A., Yih-teen L., & Antonakis, J. (2015). Effects of personality and gender on self-other agreement in ratings of transformational leadership. Academy of Management Annual Meeting Proceedings, 2015(1), 14790-14790. DOI:10.5465/AMBPP.2015.14790abstract.

Milliman, J. F., Zawacki, R. A., Norman, C., Powell, L., & Kirksey, J. (1994). Companies evaluate employees from all aspects. Personnel Journal, 73, 99-103.

Mishra, G. (2014). An exploratory study of the process and problems of 360-degree feedback in select IT companies. Compensation & Benefits Review, 46(2), 116- 122. 

National Association of State Boards of Education. (1999). Principals of change: What principals need to lead schools to excellence. National Association of State Boards of Education.

Nowack, K., & Mashihi, S. (2012). Evidence-based answers 15 questions about leveraging 360-degree feedback. Consulting Psychology Journal: Practice & Research, 64(3), 157-182.

Orr, M.T., & Orphanos, S. (2011). How graduate-level preparation influences the effectiveness of school leaders: A comparison of the outcomes of exemplary and conventional leadership preparation programs for principals. Educational Administration Quarterly, 47(1), 18-70.

Ostroff, C, Atwater, L. E., & Feinberg, B. J. (2004). Understanding self-other agreement: A look at rater characteristics, context, and outcomes. Personnel Psychology, 57, 333-375.

Quinn, R. E., & McGrath, M. R. (1985). The transformation of organizational cultures: A competing values perspective. In P.J. Frost, L. F. Moore, M. L. Louis, C. C. Lundberg, & J. Martin (Eds.). Organizational culture (pp.315-334). Beverly Hills, CA: Sage.

Quinn, R. E., & Rohrbaugh, J. (1983). A spatial model of effectiveness criteria: Towards acompeting values approach to organizational analysis. Management Science, 29(3), 363-377.

Robinson, V. M. J., Lloyd, C. A., & Rowe, K. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44, 635-674.

Sergiovanni, T. J. (1995). The principalship: A reflective practice perspective (3th ed.).Aln and Bacon.

Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology, 58(1), 33-66. DOI:10.1111/j.1744-6570. 2005.514_1.x.

Tee, D. D., & Ahmed, P. K. (2014). 360 Degree feedback: An integrative framework for learning and assessment. Teaching in Higher Education, 19(6), 579-591. DOI: 10.1080/13562517.2014.901961.

Tina. C. (2001). Personnel Issue--Or Personal Problem At Heart Of Turnover? Credit Union Journal, 5(43), 1.

Tornow, W. (1993). Perception or reality: Is multi-perceptive measurement a means or an end? Human Resource Management, 32, 221-230.

Tosti, D. T., & Addison, R. M. (2009). 360-degree feedback: Going around in circles? Performance Improvement, 48(3), 36-39.

Wan, K. W. I., Ghulam, H., & Muhammad, A. R. (2011). Integrative framework of leadership effectiveness. International Journal of Business and Social Science, 2(2), 126-132.

Wang, S.. W. (2008). The relationship study between factors of 360 degree feedback evaluation with behaviors of Goal-setting—The test of Ratees’ perception of validity by moderating or mediating effect. National Central University.

How to cite this paper

A Study of the Relationship between Different Evaluators and Principals' Leadership Effectiveness Evaluation in Feedback System

How to cite this paper: Tsai-Feng Cheng, Huei-Chun Wu, Lu-Wen Chiu, Lung-An Shen. (2022). A Study of the Relationship between Different Evaluators and Principals' Leadership Effectiveness Evaluation in Feedback SystemThe Educational Review, USA6(11), 693-708.

DOI: http://dx.doi.org/10.26855/er.2022.11.005