Journal directory listing - Volume 68 (2023) - Journal of Research in Education Sciences【68(1)】March
Directory

Construction of Indicators of Teaching Competences Among Middle School Student Teachers: A Modified Delphi Stud
Author: Pen-Hwang Liau (Department of Mathematics, National Kaohsiung Normal University), Hisn-Min Chen (Dong Shi Elementary School, Graduate Institute of Mathematics and Science Education, National Chiayi University)

Vol.&No.:Vol. 68, No. 1
Date:March 2023
Pages:73-108
DOI:https://doi.org/10.6209/JORIES.202303_68(1).0003

Abstract:
1. Background
The modern educational reform movement has continually promoted high teaching quality since the 1980s. In the education system of Taiwan, a reliable evaluation system for probationary teachers has been developed. First, since the approval of the Teachers Cultivation Law in Taiwan by legislators in 1994, both colleges and general universities have offered education programs for teaching mathematics. Second, during the teachers’ probationary period, both an experienced math teacher and a university professor play the role of supervisors and mentors. However, not all experienced school teachers have mentor training experience. Furthermore, the opinions about the criteria for assessing probationary teachers may differ between school teachers and university professors. Third, after 2002, the probationary period for new teachers in secondary schools in Taiwan was changed from 1 year (two semesters) to half a year (one semester). Therefore, identifying ways to make the half year of apprenticeship as effective as a 1-year apprenticeship is crucial. Fourth, the vision of the 12-year compulsory education is “Making All Students More Successful,” which emphasizes that students are active learners. Core competencies refer to the knowledge, ability, and attitude that an individual must possess to adapt to daily life situations and face future challenges (Ministry of Education, 2014).
Based on the aforementioned concerns, establishing an appropriate quality assessment system that not only ensures that probationary teachers’ grades are objective and consistent but also maintains the quality of all future mathematics teachers is essential. This is the rationale for developing a set of indicators to serve as a fair standard for evaluating each probationary math teacher in secondary schools. Accordingly, this study applied a modified Delphi method to establish a set of feasible and practical indicators for the evaluation of the teaching competence of probationary mathematics teachers in Taiwan. Moreover, the proposed modified Delphi method was tested and verified.
2. Review of Literature on the Delphi Method
The Delphi technique is a process of collecting and refining the opinions of experts in order to obtain a consensus on a particular topic of present or future action, especially topics for which there is little knowledge of certainty (Dalkey & Helmer, 1963; Fischer, 1978; Hardy et al., 2004; Powell, 2003). The Delphi method has been widely applied in education, business, industry, heath care, and many other fields worldwide.
Although the Delphi method is notable for its democratic, structured approach and participant anonymity, little is known about the minimum level of agreement required to achieve a consensus, thus leaving the technique open to criticism (Goodman, 1987; Keeney et al., 2001; Osborne et al., 2003; Powell, 2003; Reid, 1988; Rowe et al., 1991; Williams & Webb, 1994). Concerns regarding this technique include how to achieve a consensus for an indicator and what is the minimum level of agreement to reach a consensus in a given situation.
3. Methods
Step 1: Set the target values
Because the expert panel in this study comprised 25 experts and a topic from the education field was selected, we used a higher criterion to reach a consensus. After discussion with other researchers, we decided to use a 5-point Likert scale and set the following target values: (1) the percentage of respondents choosing “5” should be greater than 65% without no one choosing “1”or “2”; (2) For mean, if 17 experts choose “5” and 8 experts choose “3”, set the mean as 4.36. (3) For standard deviation, if 17 experts choose “5”, 4 experts choose “4”, and the other 4 experts choose “3”, set the SD as 0.77.
Step 2: Compare the observation results with the target values
After determining the target values, means, and standard deviations, we perform the statistical hypothesis process to reach a consensus as follows.
(1) Testing of the Standard Deviation
 vs.
First, we compare the sample standard deviation for each indicator with the target value through statistical hypothesis testing. If the null hypothesis is not rejected, it indicates that the expert panel’s opinions are not consistent, and that the indicators must be modified and experts must be consulted again for further analysis until a consensus is reached. Otherwise, if the null hypothesis is rejected, it indicates that the experts have reached a consensus, and that further input from the expert panel is not needed. We then proceed with testing the mean of the indicator.
(2) Testing of the Mean
 vs.
After the standard deviation is tested, the mean of the indicator is assessed to validate its’ importance.
If the null hypothesis is rejected, it indicates that a consensus has been reached for the expert panel’s opinions, and that further input from the expert panel is not needed. Otherwise, if the null hypothesis is not rejected, the indicators must be modified, and that the experts must be consulted again for further analysis until a consensus is reached. If the experts are consulted again, the standard deviation testing must also be performed again.
To sum up, this modified method is more stringent than the traditional Delphi method and more efficiently identifies final indicators because some ideal indicators may be preserved only through one or two rounds.
4. Results
This study found that a set of 4 aspects, 7 vectors, and 34 indicators are essential components of teaching competences of middle school student teachers.
5. Conclusion
(1) A set of indicators were established in this study by considering aspects such as mathematics teaching, class management, evaluation, and attitude. These indicators emphasized “perceptible,” “hands-on learning,” “motivation,” and “technology integration,” which corresponded to the core competencies of the 12-year compulsory education.
(2) The proposed modified Delphi method can be used to effectively and accurately judge the expert panel’s consensus. For example, a consensus was reached for the opinions of the expert panel regarding 16 indicators in round 2; therefore, the experts only had to judge the last indicators in round 3.

Keywords:12-year compulsory education, middle school student teachers, modified Delphi study

《Full Text》 檔名

References:
  1. 左台益、李健恆(2018)。素養導向之數學教材設計與發展。教育科學研究期刊,63(4),29-58。https://doi.org/10.6209/JORIES.201812_63(4).0002【Tso, T.-Y., & Lei, K.-H. (2018). Design and development of mathematical literacy-oriented subject materials. Journal of Research in Education Sciences, 63(4), 29-58. https://doi.org/10.6209/JORIES.201812_63(4).0002】
  2. 左台益、胡政德(2009)。準教師從真實情境中建構數學模式的認知因素分析與機制。當代教育研究季刊,17(4),61-101。https://doi.org/10.6151/CERQ.2009.1704.03 【Tso, T.-Y., & Hu, C.-T. (2009). Analyzing and understanding the cognitive factors and translation mechanisms of pre-service teachers in their processes of mathematical modeling. Contemporary Educational Research Quarterly, 17(4), 61-101. https://doi.org/10.6151/CERQ.2009.1704.03】
  3. 吳正新(2019)。數學素養導向評量試題研發策略。中等教育,70(3),11-35。https://doi.org/ 10.6249/SE.201909_70(3).0024【Wu, J.-S. (2019). The approaches of developing mathematical literacy-based assessment. Secondary Education, 70(3), 11-35. https://doi.org/10.6249/SE.201909_70(3).0024】
  4. 吳清基、黃嘉莉、張明文(2011)。我國師資培育政策回顧與展望。載於國家教育研究院(主編),我國百年教育回顧與展望(頁1-20)。國家教育研究院。【Wu, C.-J., Huang, J.-L., & Chang, M.-W. (2011). Retrospect and prospect of teacher education policy in Taiwan. In National Academy for Education Research (Ed.), Retrospect and prospect of education over the past one hundred years in Taiwan (pp. 1-20). National Academy for Educational Research.】
  5. 吳麗珍、鄭碧雲、郭重吉(2018)。國小數理教師教學專業能力類型之探討。師資培育與教師專業發展期刊,11(2),27-61。https://doi.org/10.3966/207136492018081102002【Wu, L.-C., Cheng, P.-Y., & Guo, C.-J. (2018). A study on the classification of elementary school mathematics/ science teachers regarding their professional teaching competence. Journal of Teacher Education and Professional Development, 11(2), 27-61. https://doi.org/10.3966/207136492018081102002】
» More
APA FormatLiau, P.-H., & Chen, H.-M. (2023). Construction of indicators of teaching competences among middle school student teachers: A modified delphi study. Journal of Research in Education Sciences, 68(1), 73-108. https://doi.org/10.6209/JORIES.202303_68(1).0003