The aim of this research has been to help improve the performance evaluation of physical education teachers by identifying factors involved in such a task and exploring their relevance through a survey of such teachers in Tehran. A cluster sample of 384 physical education teachers was selected from among all such teachers in Tehran’s 19 districts divided into five geographic areas. Data was collected by distributing and collecting a questionnaire of 47 items on the assessment of physical education teachers, with the internal consistency of 0.79. Confirmatory factor analysis of the collected data yielded the following results: The identified factors are adequately fit to the model wherein the general performance, curricular performance, performance in extracurricular activities, administrative performance, and factors degrading performance were considered as important in evaluation of physical education teachers’ performance. Furthermore, the responding teachers believe that a committee should do such an evaluation at the end of each semester.