Email this article 
Reliability and feasibility of an evaluation tool of teacher effectiveness and the quality of physical education sessions
Abstract
The need to ensure quality physical education has motivated the development of a reliable method to evaluate physical education sessions, capable of detecting areas of improvement, thus facilitating the continuous growth of the teaching process. The main aim of the present study is to design a feasible and reliable evaluation instrument for physical education sessions, and to determine its reliability and feasibility with a group of practicing physical education teachers. Two evaluations of the same session (videotaped) were conducted to determine whether the instrument was reliable and feasible (n = 20), 9 women and 11 men, leaving 2 weeks between the first and the second evaluation. One-way analysis of variance (ANOVA) and intraclass correlation coefficient (ICC) were performed. The total score of the evaluation instrument shows an ICC of 0.953, (95%CI 0.881; 0.982), with a p-value ≤ .001. When comparing the responses of teachers from different educational levels (primary, secondary, and university), no significant differences were found between responses to any of the items or in the total score on either occasion. Total score in the test was (69.3 mean, [14.0 SD]), p-value = .881; and (66.2, [13.9]) p-value = .943 in the retest. In conclusion, the present evaluation instrument is feasible and reliable for the evaluation of physical education sessions.
Keywords
References
Altman, D. G., & Bland, J. M. (1983). Measurement in Medicine: The Analysis of Method Comparison Studies. The Statistician, 32(3), 307. https://doi.org/10.2307/2987937
Borjas, M. (2011). Peer assessment as a democratizing experience: Case of a Teacher Preparation Program. Revista Del Instituto de Estudios En Educación Universidad Del Norte.
Burgueño, R., González-Cutre, D., Sevil-Serrano, J., Herrador-Colmenero, M., Segura-Díaz, J. M., Medina-Casaubón, J., & Chillón, P. (2019). Understanding the motivational processes involved in adolescents' active commuting behaviour: Development and validation of the Behavioural Regulation in Active Commuting to and from School (BR-ACS) Questionnaire. Transportation Research Part F: Traffic Psychology and Behaviour, 62, 615-625. https://doi.org/10.1016/j.trf.2019.02.016
Cano García, M. E., Pons Seguí, L., & Lluch Molins, L. (2018). Análisis de experiencias de innovación docente universitarias sobre evaluación. Profesorado, Revista de Currículum y Formación Del Profesorado, 22(4). https://doi.org/10.30827/profesorado.v22i4.8392
Caracuel, R., Padial, R., Torres, B., & Cepero, M. (2020). The influence of healthy habits acquired by school-age adolescents in relation to physical education classes. In Journal of Human Sport and Exercise - 2020 - Summer Conferences of Sports Science. Universidad de Alicante. https://doi.org/10.14198/jhse.2020.15.Proc4.02
Danielson, C. (2014). The framework for teaching: Evaluation instrument. Journal of Research in Music Education (Vol. 66). https://doi.org/10.1177/0022429418793645
Dyson, M., & Plunkett, M. (2014). Enhancing interpersonal relationships in teacher education through the development and practice of reflective mentoring. (Interperso). https://doi.org/10.1007/978-94-6209-701-8_4
Edufisaludable. (2021). Why is it necessary to research physical education and the promotion of healthy habits? Retrieved from https://edufisaludable.com/en/why-is-it-necessary-to-research-physical-education-and-the-promotion-of-healthy-habits/
Fernández-Rivas, M., & Espada-Mateos, M. (2019). The knowledge, continuing education and use of teaching styles in Physical Education teachers. Journal of Human Sport and Exercise, 14(1). https://doi.org/10.14198/jhse.2019.141.08
Fernández, J., Hortigüela, D., & Pérez, Á. (2018). Revisando los modelos pedagógicos en educación física . Ideas clave para incorporarlos al aula. Revista Española de Educación Física y Deportes, (423), 57-80.
García Carrillo, L. S. (2016). La autoevaluación de los estudiantes un proceso por resignificar y reconstruir en la educación física escolar. Paideia Surcolombiana, (21), 27-42. https://doi.org/10.25054/01240307.1454
González-Valero, G., San Román-Mata, S., Ubago-Jiménez, J. L., & Puertas-Molero, P. (2020). Physical-healthy and psychosocial differences in school children: A study of gender. Journal of Human Sport and Exercise, 17(2). https://doi.org/10.14198/jhse.2022.172.07
González Palacio, E. V., Chaverra Fernández, B. E., Bustamante Castaño, S. A., & Toro Suaza, C. A. (2020). Diseño y validación de un cuestionario sobre las concepciones y percepción de los estudiantes sobre la evaluación en Educación Física (Design and validation of a questionnaire about the conceptions and perception of the students about the assessment in P. Retos, 2041(40), 317-325. https://doi.org/10.47197/retos.v1i40.80914
Hamodi, C., López Pastor, V. M., & López Pastor, A. T. (2015). Medios, técnicas e instrumentos de evaluación formativa y compartida del aprendizaje en educación superior. Perfiles Educativos, 37 (147), 146-161. https://doi.org/10.22201/iisue.24486167e.2015.147.47271
Kyrgiridis, P., Derri, V., Emmanouilidou, K., Chlapoutaki, E., & Kioumourtzoglou, E. (2014). Development of a Questionnaire for Self-Evaluation of Teacher Effectiveness in Physical Education (SETEQ-PE). Measurement in Physical Education and Exercise Science, 18(2), 73-90. https://doi.org/10.1080/1091367X.2013.866557
Lindsay, E. (2014). Effective teaching in physical education: The view from a variety of trenches. Research Quarterly for Exercise and Sport, 85, 31 -37. https://doi.org/10.1080/02701367.2014.873330
López Pastor, V. M., & Pérez Pueyo, Á. (2017). Evaluación formativa y compartida en educación experiencias de éxito en todas las etapas educativas. (U. de León, Ed.).
Mercier, K., & Doolittle, S. (2013). Assessing student achievement in physical education for teacher evaluation. Journal of Physical Education, Recreation & Dance, 84(3), 38-42. https://doi.org/10.1080/07303084.2013.767721
Metzler, M. (2014). Teacher effectiveness research in physical education: The future isn't what it used to be. Research Quarterly for Exercise and Sport, 85, 14 -19. https://doi.org/10.1080/02701367.2014.872932
Muntaner-Mas, A., Martinez-Nicolas, A., Quesada, A., Cadenas-Sanchez, C., & Ortega, F. B. (2021). Smartphone App (2kmFIT-App) for Measuring Cardiorespiratory Fitness: Validity and Reliability Study. JMIR MHealth and UHealth, 9(1), e14864. https://doi.org/10.2196/14864
National Association for Sport and Physical Education (NASPE). (2007). Physical education teacher evaluation tool. Retrieved April 16, 2021, from https://www.michigan.gov/documents/mde/NASPETool_212381_7.pdf
Navarro-Patón, R., Lago-Ballesteros, J., Basanta-Camiño, S., & Arufe-Giraldez, V. (2019). Relation between motivation and enjoyment in physical education classes in children from 10 to 12 years old. Journal of Human Sport and Exercise, 14(3). https://doi.org/10.14198/jhse.2019.143.04
Rink, J. (2014). Teacher Effectiveness in Physical Education-Consensus? Research Quarterly for Exercise and Sport, 85(3), 282-286. https://doi.org/10.1080/02701367.2014.932656
Rink, J. E. (2013). Measuring teacher effectiveness in physical education. Research Quarterly for Exercise and Sport, 84, 407-418. https://doi.org/10.1080/02701367.2013.844018
Sánchez Torrejón, B., & Barea Villalba, Z. (2019). Towards a violet school: Teachers' of Primary education initial training in coeducation. Tendencias Pedagógicas. https://doi.org/10.15366/tp2019.34.007
SHAPE America - Society of Health and Physical Educators. (2016). 20 Indicators of Effective Physical Education Instruction. Retrieved April 16, 2021, from https://www.shapeamerica.org/events/upload/20-Indicators-Brochure-WEB-003-2.pdf
Villarroel, V., & Bruna, D. (2019). ¿Evaluamos lo que realmente importa? el desafío de la evaluación auténtica en educación superior. Calidad En La Educación, (50), 492. https://doi.org/10.31619/caledu.n50.729
Ward, P. (2013). The role of content knowledge in conceptions of teaching effectiveness in physical education. Research Quarterly in Physical Education, 84, 431-440. https://doi.org/10.1080/02701367.2013.844045
DOI: https://doi.org/10.14198/jhse.2023.181.14
Copyright (c) 2018 Journal of Human Sport and Exercise
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.