Journal of Human Sport and Exercise

Reliability and feasibility of an evaluation tool of teacher effectiveness and the quality of physical education sessions

Aina Maria Galmes-Panades, Pere Palou-Sampol, Pere Antoni Borras, Adria Muntaner-Mas

DOI: https://doi.org/10.14198/jhse.2023.181.14

Abstract

The need to ensure quality physical education has motivated the development of a reliable method to evaluate physical education sessions, capable of detecting areas of improvement, thus facilitating the continuous growth of the teaching process. The main aim of the present study is to design a feasible and reliable evaluation instrument for physical education sessions, and to determine its reliability and feasibility with a group of practicing physical education teachers. Two evaluations of the same session (videotaped) were conducted to determine whether the instrument was reliable and feasible (n = 20), 9 women and 11 men, leaving 2 weeks between the first and the second evaluation. One-way analysis of variance (ANOVA) and intraclass correlation coefficient (ICC) were performed. The total score of the evaluation instrument shows an ICC of 0.953, (95%CI 0.881; 0.982), with a p-value ≤ .001. When comparing the responses of teachers from different educational levels (primary, secondary, and university), no significant differences were found between responses to any of the items or in the total score on either occasion. Total score in the test was (69.3 mean, [14.0 SD]), p-value = .881; and (66.2, [13.9]) p-value = .943 in the retest. In conclusion, the present evaluation instrument is feasible and reliable for the evaluation of physical education sessions.


Keywords

Numerical observational scale; Teacher evaluation; Primary education; Secondary education; University education

References

Altman, D. G., & Bland, J. M. (1983). Measurement in Medicine: The Analysis of Method Comparison Studies. The Statistician, 32(3), 307. https://doi.org/10.2307/2987937

Borjas, M. (2011). Peer assessment as a democratizing experience: Case of a Teacher Preparation Program. Revista Del Instituto de Estudios En Educación Universidad Del Norte.

Burgueño, R., González-Cutre, D., Sevil-Serrano, J., Herrador-Colmenero, M., Segura-Díaz, J. M., Medina-Casaubón, J., & Chillón, P. (2019). Understanding the motivational processes involved in adolescents' active commuting behaviour: Development and validation of the Behavioural Regulation in Active Commuting to and from School (BR-ACS) Questionnaire. Transportation Research Part F: Traffic Psychology and Behaviour, 62, 615-625. https://doi.org/10.1016/j.trf.2019.02.016

Cano García, M. E., Pons Seguí, L., & Lluch Molins, L. (2018). Análisis de experiencias de innovación docente universitarias sobre evaluación. Profesorado, Revista de Currículum y Formación Del Profesorado, 22(4). https://doi.org/10.30827/profesorado.v22i4.8392

Caracuel, R., Padial, R., Torres, B., & Cepero, M. (2020). The influence of healthy habits acquired by school-age adolescents in relation to physical education classes. In Journal of Human Sport and Exercise - 2020 - Summer Conferences of Sports Science. Universidad de Alicante. https://doi.org/10.14198/jhse.2020.15.Proc4.02

Danielson, C. (2014). The framework for teaching: Evaluation instrument. Journal of Research in Music Education (Vol. 66). https://doi.org/10.1177/0022429418793645

Dyson, M., & Plunkett, M. (2014). Enhancing interpersonal relationships in teacher education through the development and practice of reflective mentoring. (Interperso). https://doi.org/10.1007/978-94-6209-701-8_4

Edufisaludable. (2021). Why is it necessary to research physical education and the promotion of healthy habits? Retrieved from https://edufisaludable.com/en/why-is-it-necessary-to-research-physical-education-and-the-promotion-of-healthy-habits/

Fernández-Rivas, M., & Espada-Mateos, M. (2019). The knowledge, continuing education and use of teaching styles in Physical Education teachers. Journal of Human Sport and Exercise, 14(1). https://doi.org/10.14198/jhse.2019.141.08

Fernández, J., Hortigüela, D., & Pérez, Á. (2018). Revisando los modelos pedagógicos en educación física . Ideas clave para incorporarlos al aula. Revista Española de Educación Física y Deportes, (423), 57-80.

García Carrillo, L. S. (2016). La autoevaluación de los estudiantes un proceso por resignificar y reconstruir en la educación física escolar. Paideia Surcolombiana, (21), 27-42. https://doi.org/10.25054/01240307.1454

González-Valero, G., San Román-Mata, S., Ubago-Jiménez, J. L., & Puertas-Molero, P. (2020). Physical-healthy and psychosocial differences in school children: A study of gender. Journal of Human Sport and Exercise, 17(2). https://doi.org/10.14198/jhse.2022.172.07

González Palacio, E. V., Chaverra Fernández, B. E., Bustamante Castaño, S. A., & Toro Suaza, C. A. (2020). Diseño y validación de un cuestionario sobre las concepciones y percepción de los estudiantes sobre la evaluación en Educación Física (Design and validation of a questionnaire about the conceptions and perception of the students about the assessment in P. Retos, 2041(40), 317-325. https://doi.org/10.47197/retos.v1i40.80914

Hamodi, C., López Pastor, V. M., & López Pastor, A. T. (2015). Medios, técnicas e instrumentos de evaluación formativa y compartida del aprendizaje en educación superior. Perfiles Educativos, 37 (147), 146-161. https://doi.org/10.22201/iisue.24486167e.2015.147.47271

Kyrgiridis, P., Derri, V., Emmanouilidou, K., Chlapoutaki, E., & Kioumourtzoglou, E. (2014). Development of a Questionnaire for Self-Evaluation of Teacher Effectiveness in Physical Education (SETEQ-PE). Measurement in Physical Education and Exercise Science, 18(2), 73-90. https://doi.org/10.1080/1091367X.2013.866557

Lindsay, E. (2014). Effective teaching in physical education: The view from a variety of trenches. Research Quarterly for Exercise and Sport, 85, 31 -37. https://doi.org/10.1080/02701367.2014.873330

López Pastor, V. M., & Pérez Pueyo, Á. (2017). Evaluación formativa y compartida en educación experiencias de éxito en todas las etapas educativas. (U. de León, Ed.).

Mercier, K., & Doolittle, S. (2013). Assessing student achievement in physical education for teacher evaluation. Journal of Physical Education, Recreation & Dance, 84(3), 38-42. https://doi.org/10.1080/07303084.2013.767721

Metzler, M. (2014). Teacher effectiveness research in physical education: The future isn't what it used to be. Research Quarterly for Exercise and Sport, 85, 14 -19. https://doi.org/10.1080/02701367.2014.872932

Muntaner-Mas, A., Martinez-Nicolas, A., Quesada, A., Cadenas-Sanchez, C., & Ortega, F. B. (2021). Smartphone App (2kmFIT-App) for Measuring Cardiorespiratory Fitness: Validity and Reliability Study. JMIR MHealth and UHealth, 9(1), e14864. https://doi.org/10.2196/14864

National Association for Sport and Physical Education (NASPE). (2007). Physical education teacher evaluation tool. Retrieved April 16, 2021, from https://www.michigan.gov/documents/mde/NASPETool_212381_7.pdf

Navarro-Patón, R., Lago-Ballesteros, J., Basanta-Camiño, S., & Arufe-Giraldez, V. (2019). Relation between motivation and enjoyment in physical education classes in children from 10 to 12 years old. Journal of Human Sport and Exercise, 14(3). https://doi.org/10.14198/jhse.2019.143.04

Rink, J. (2014). Teacher Effectiveness in Physical Education-Consensus? Research Quarterly for Exercise and Sport, 85(3), 282-286. https://doi.org/10.1080/02701367.2014.932656

Rink, J. E. (2013). Measuring teacher effectiveness in physical education. Research Quarterly for Exercise and Sport, 84, 407-418. https://doi.org/10.1080/02701367.2013.844018

Sánchez Torrejón, B., & Barea Villalba, Z. (2019). Towards a violet school: Teachers' of Primary education initial training in coeducation. Tendencias Pedagógicas. https://doi.org/10.15366/tp2019.34.007

SHAPE America - Society of Health and Physical Educators. (2016). 20 Indicators of Effective Physical Education Instruction. Retrieved April 16, 2021, from https://www.shapeamerica.org/events/upload/20-Indicators-Brochure-WEB-003-2.pdf

Villarroel, V., & Bruna, D. (2019). ¿Evaluamos lo que realmente importa? el desafío de la evaluación auténtica en educación superior. Calidad En La Educación, (50), 492. https://doi.org/10.31619/caledu.n50.729

Ward, P. (2013). The role of content knowledge in conceptions of teaching effectiveness in physical education. Research Quarterly in Physical Education, 84, 431-440. https://doi.org/10.1080/02701367.2013.844045




DOI: https://doi.org/10.14198/jhse.2023.181.14





Copyright (c) 2018 Journal of Human Sport and Exercise

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.