Reliability and feasibility of an evaluation tool of teacher effectiveness and the quality of physical education sessions
DOI:
https://doi.org/10.14198/jhse.2023.181.14Keywords:
Numerical observational scale, Teacher evaluation, Primary education, Secondary education, University educationAbstract
The need to ensure quality physical education has motivated the development of a reliable method to evaluate physical education sessions, capable of detecting areas of improvement, thus facilitating the continuous growth of the teaching process. The main aim of the present study is to design a feasible and reliable evaluation instrument for physical education sessions, and to determine its reliability and feasibility with a group of practicing physical education teachers. Two evaluations of the same session (videotaped) were conducted to determine whether the instrument was reliable and feasible (n = 20), 9 women and 11 men, leaving 2 weeks between the first and the second evaluation. One-way analysis of variance (ANOVA) and intraclass correlation coefficient (ICC) were performed. The total score of the evaluation instrument shows an ICC of 0.953, (95%CI 0.881; 0.982), with a p-value ≤ .001. When comparing the responses of teachers from different educational levels (primary, secondary, and university), no significant differences were found between responses to any of the items or in the total score on either occasion. Total score in the test was (69.3 mean, [14.0 SD]), p-value = .881; and (66.2, [13.9]) p-value = .943 in the retest. In conclusion, the present evaluation instrument is feasible and reliable for the evaluation of physical education sessions.
Downloads
References
Altman, D. G., & Bland, J. M. (1983). Measurement in Medicine: The Analysis of Method Comparison Studies. The Statistician, 32(3), 307. https://doi.org/10.2307/2987937
Borjas, M. (2011). Peer assessment as a democratizing experience: Case of a Teacher Preparation Program. Revista Del Instituto de Estudios En Educación Universidad Del Norte.
Burgueño, R., González-Cutre, D., Sevil-Serrano, J., Herrador-Colmenero, M., Segura-Díaz, J. M., Medina-Casaubón, J., & Chillón, P. (2019). Understanding the motivational processes involved in adolescents' active commuting behaviour: Development and validation of the Behavioural Regulation in Active Commuting to and from School (BR-ACS) Questionnaire. Transportation Research Part F: Traffic Psychology and Behaviour, 62, 615-625. https://doi.org/10.1016/j.trf.2019.02.016
Cano García, M. E., Pons Seguí, L., & Lluch Molins, L. (2018). Análisis de experiencias de innovación docente universitarias sobre evaluación. Profesorado, Revista de Currículum y Formación Del Profesorado, 22(4). https://doi.org/10.30827/profesorado.v22i4.8392
Caracuel, R., Padial, R., Torres, B., & Cepero, M. (2020). The influence of healthy habits acquired by school-age adolescents in relation to physical education classes. In Journal of Human Sport and Exercise - 2020 - Summer Conferences of Sports Science. Universidad de Alicante. https://doi.org/10.14198/jhse.2020.15.Proc4.02
Danielson, C. (2014). The framework for teaching: Evaluation instrument. Journal of Research in Music Education (Vol. 66). https://doi.org/10.1177/0022429418793645
Dyson, M., & Plunkett, M. (2014). Enhancing interpersonal relationships in teacher education through the development and practice of reflective mentoring. (Interperso). https://doi.org/10.1007/978-94-6209-701-8_4
Edufisaludable. (2021). Why is it necessary to research physical education and the promotion of healthy habits? Retrieved from https://edufisaludable.com/en/why-is-it-necessary-to-research-physical-education-and-the-promotion-of-healthy-habits/
Fernández-Rivas, M., & Espada-Mateos, M. (2019). The knowledge, continuing education and use of teaching styles in Physical Education teachers. Journal of Human Sport and Exercise, 14(1). https://doi.org/10.14198/jhse.2019.141.08
Fernández, J., Hortigüela, D., & Pérez, Á. (2018). Revisando los modelos pedagógicos en educación física . Ideas clave para incorporarlos al aula. Revista Española de Educación Física y Deportes, (423), 57-80.
García Carrillo, L. S. (2016). La autoevaluación de los estudiantes un proceso por resignificar y reconstruir en la educación física escolar. Paideia Surcolombiana, (21), 27-42. https://doi.org/10.25054/01240307.1454
González-Valero, G., San Román-Mata, S., Ubago-Jiménez, J. L., & Puertas-Molero, P. (2020). Physical-healthy and psychosocial differences in school children: A study of gender. Journal of Human Sport and Exercise, 17(2). https://doi.org/10.14198/jhse.2022.172.07
González Palacio, E. V., Chaverra Fernández, B. E., Bustamante Castaño, S. A., & Toro Suaza, C. A. (2020). Diseño y validación de un cuestionario sobre las concepciones y percepción de los estudiantes sobre la evaluación en Educación Física (Design and validation of a questionnaire about the conceptions and perception of the students about the assessment in P. Retos, 2041(40), 317-325. https://doi.org/10.47197/retos.v1i40.80914
Hamodi, C., López Pastor, V. M., & López Pastor, A. T. (2015). Medios, técnicas e instrumentos de evaluación formativa y compartida del aprendizaje en educación superior. Perfiles Educativos, 37 (147), 146-161. https://doi.org/10.22201/iisue.24486167e.2015.147.47271
Kyrgiridis, P., Derri, V., Emmanouilidou, K., Chlapoutaki, E., & Kioumourtzoglou, E. (2014). Development of a Questionnaire for Self-Evaluation of Teacher Effectiveness in Physical Education (SETEQ-PE). Measurement in Physical Education and Exercise Science, 18(2), 73-90. https://doi.org/10.1080/1091367X.2013.866557
Lindsay, E. (2014). Effective teaching in physical education: The view from a variety of trenches. Research Quarterly for Exercise and Sport, 85, 31 -37. https://doi.org/10.1080/02701367.2014.873330
López Pastor, V. M., & Pérez Pueyo, Á. (2017). Evaluación formativa y compartida en educación experiencias de éxito en todas las etapas educativas. (U. de León, Ed.).
Mercier, K., & Doolittle, S. (2013). Assessing student achievement in physical education for teacher evaluation. Journal of Physical Education, Recreation & Dance, 84(3), 38-42. https://doi.org/10.1080/07303084.2013.767721
Metzler, M. (2014). Teacher effectiveness research in physical education: The future isn't what it used to be. Research Quarterly for Exercise and Sport, 85, 14 -19. https://doi.org/10.1080/02701367.2014.872932
Muntaner-Mas, A., Martinez-Nicolas, A., Quesada, A., Cadenas-Sanchez, C., & Ortega, F. B. (2021). Smartphone App (2kmFIT-App) for Measuring Cardiorespiratory Fitness: Validity and Reliability Study. JMIR MHealth and UHealth, 9(1), e14864. https://doi.org/10.2196/14864
National Association for Sport and Physical Education (NASPE). (2007). Physical education teacher evaluation tool. Retrieved April 16, 2021, from https://www.michigan.gov/documents/mde/NASPETool_212381_7.pdf
Navarro-Patón, R., Lago-Ballesteros, J., Basanta-Camiño, S., & Arufe-Giraldez, V. (2019). Relation between motivation and enjoyment in physical education classes in children from 10 to 12 years old. Journal of Human Sport and Exercise, 14(3). https://doi.org/10.14198/jhse.2019.143.04
Rink, J. (2014). Teacher Effectiveness in Physical Education-Consensus? Research Quarterly for Exercise and Sport, 85(3), 282-286. https://doi.org/10.1080/02701367.2014.932656
Rink, J. E. (2013). Measuring teacher effectiveness in physical education. Research Quarterly for Exercise and Sport, 84, 407-418. https://doi.org/10.1080/02701367.2013.844018
Sánchez Torrejón, B., & Barea Villalba, Z. (2019). Towards a violet school: Teachers' of Primary education initial training in coeducation. Tendencias Pedagógicas. https://doi.org/10.15366/tp2019.34.007
SHAPE America - Society of Health and Physical Educators. (2016). 20 Indicators of Effective Physical Education Instruction. Retrieved April 16, 2021, from https://www.shapeamerica.org/events/upload/20-Indicators-Brochure-WEB-003-2.pdf
Villarroel, V., & Bruna, D. (2019). ¿Evaluamos lo que realmente importa? el desafío de la evaluación auténtica en educación superior. Calidad En La Educación, (50), 492. https://doi.org/10.31619/caledu.n50.729
Ward, P. (2013). The role of content knowledge in conceptions of teaching effectiveness in physical education. Research Quarterly in Physical Education, 84, 431-440. https://doi.org/10.1080/02701367.2013.844045
Downloads
Statistics
Published
How to Cite
Issue
Section
License
Each author warrants that his or her submission to the Work is original and that he or she has full power to enter into this agreement. Neither this Work nor a similar work has been published elsewhere in any language nor shall be submitted for publication elsewhere while under consideration by JHSE. Each author also accepts that the JHSE will not be held legally responsible for any claims of compensation.
Authors wishing to include figures or text passages that have already been published elsewhere are required to obtain permission from the copyright holder(s) and to include evidence that such permission has been granted when submitting their papers. Any material received without such evidence will be assumed to originate from the authors.
Please include at the end of the acknowledgements a declaration that the experiments comply with the current laws of the country in which they were performed. The editors reserve the right to reject manuscripts that do not comply with the abovementioned requirements. The author(s) will be held responsible for false statements or failure to fulfill the above-mentioned requirements.
This title is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International license (CC BY-NC-ND 4.0).
You are free to share, copy and redistribute the material in any medium or format. The licensor cannot revoke these freedoms as long as you follow the license terms under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
Transfer of Copyright
In consideration of JHSE’s publication of the Work, the authors hereby transfer, assign, and otherwise convey all copyright ownership worldwide, in all languages, and in all forms of media now or hereafter known, including electronic media such as CD-ROM, Internet, and Intranet, to JHSE. If JHSE should decide for any reason not to publish an author’s submission to the Work, JHSE shall give prompt notice of its decision to the corresponding author, this agreement shall terminate, and neither the author nor JHSE shall be under any further liability or obligation.
Each author certifies that he or she has no commercial associations (e.g., consultancies, stock ownership, equity interest, patent/licensing arrangements, etc.) that might pose a conflict of interest in connection with the submitted article, except as disclosed on a separate attachment. All funding sources supporting the Work and all institutional or corporate affiliations of the authors are acknowledged in a footnote in the Work.
Each author certifies that his or her institution has approved the protocol for any investigation involving humans or animals and that all experimentation was conducted in conformity with ethical and humane principles of research.
Competing Interests
Biomedical journals typically require authors and reviewers to declare if they have any competing interests with regard to their research.
JHSE require authors to agree to Copyright Notice as part of the submission process.
