期刊目錄列表 - 67卷(2022) - 【教育科學研究期刊】67(1)三月刊
Directory
國中教育會考數學科的回沖效應初探
作者:國立臺灣師範大學心理與教育測驗研究發展中心張銘秋、國立臺灣師範大學心理與教育測驗研究發展中心黃瓅瑩、國立臺灣師範大學心理與教育測驗研究發展中心陳佳蓉、國立臺灣師範大學教育心理與輔導學系暨心理與教育測驗研究發展中心暨學習科學跨國頂尖研究中心陳柏熹、國立臺灣師範大學心理與教育測驗研究發展中心陳佳蓉、國立臺灣師範大學心理與教育測驗研究發展中心暨學習科學跨國頂尖研究中心曾芬蘭
卷期：67卷第1期
日期：2022年3月
頁碼：227-254
DOI：https://doi.org/10.6209/JORIES.202203_67(1).0008
摘要：
本研究探討臺灣實施國中教育會考對數學科教學現場的回沖效應，透過教師問卷，比較國中數學教師在國中教育會考實施前後的教學差異，並調查其於衍生之相關議題的感受與態度。問卷調查結果顯示：一、近七成教師認同會花費較多的時間教授基測／教育會考常考的內容；二、教師在兩時期使用的教材仍以教科書與習作為主，約有六成教師經常使用測驗卷或考古題；教育會考時期非選擇題型式測驗卷或考古題的使用率較基測時期高（約高7.5%）；三、教學方法均以教師單向講述或師生雙向問答為主；四、教師在數學的閱讀理解能力重視程度比基測時期增加最多，其次為數學表達、溝通能力；五、學校評量各題型的比重未有明顯變化，但教育會考時期非選擇題比重有微幅提高；六、半數以上的教師不認同成績由百分等級制改為三等級，可降低學生學習壓力，且近七成教師認為易造成中等程度學生學習動機低落。由上述研究結果可知，國中教育會考數學科確實對國中數學教學現場同時產生了正向與負向的影響。
關鍵詞：回沖效應、高風險測驗、國中教育會考、數學非選擇題
《詳全文》
參考文獻：
- 宋曜廷（2012，9月17日）。十二年國教要競爭力不要壓力。中國時報。http://only-perception. blogspot.com/2012/09/blog-post_18.html 【Sung, Y.-T. (2012, September 17). The 12-Year Compulsory Education appeals for competitiveness, not stress. China Times. http://only-perception.blogspot.com/2012/09/blog-post_18.html】
- 宋曜廷、趙子揚、王雅鈴、黃瓅瑩、陳佳蓉、曾芬蘭（2013）。「中學生考試壓力量表」之編製及其信度與效度之分析。測驗學刊，60（2），291-318. 【Sung, Y.-T., Chao, T.-Y., Wang, Y.-L., Huang, L.-Y., Chen, C.-J., & Tseng, F.-L. (2013). The development of examination stress scale for junior high school students. Psychological Testing, 60(2), 291-318.】
- 侯傑泰、何穎欣（2008）。學習回饋及系統監察：香港的經驗。教育研究與發展期刊，4（4），1-18。 【Hau, K.-T., & Ho, J. W. Y. (2008). Feedback and system monitoring of students learning: The Hong Kong experience. Journal of Education Research and Development, 4(4), 1-18.】
- 張鎮華（2017）。數學學科知識也是數學素養（數學素養系列之3）。高中數學學科中心電子報，123。https://ghresource.mt.ntnu.edu.tw/uploads/1644995378956mONmCFXd.pdf 【Chang, G.-J. (2017). Fundamental mathematical knowledge is also part of mathematical literacy (Mathematical Literacy- Part 3). The Newsletter of Mathematics Education Resource Center, 123. https://ghresource.mt.ntnu. edu.tw/uploads/1644995378956mONmCFXd.pdf】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2014）。教育會考與國中基測比較表。https://cap.rcpet.edu.tw/background.html 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2014). The comparison and contrast chart between Comprehensive Assessment Program for Junior High School Students and the Basic Competence Test for Junior High School Students. https://cap.rcpet.edu.tw/background.html】
» 展開更多
- 宋曜廷（2012，9月17日）。十二年國教要競爭力不要壓力。中國時報。http://only-perception. blogspot.com/2012/09/blog-post_18.html 【Sung, Y.-T. (2012, September 17). The 12-Year Compulsory Education appeals for competitiveness, not stress. China Times. http://only-perception.blogspot.com/2012/09/blog-post_18.html】
- 宋曜廷、趙子揚、王雅鈴、黃瓅瑩、陳佳蓉、曾芬蘭（2013）。「中學生考試壓力量表」之編製及其信度與效度之分析。測驗學刊，60（2），291-318. 【Sung, Y.-T., Chao, T.-Y., Wang, Y.-L., Huang, L.-Y., Chen, C.-J., & Tseng, F.-L. (2013). The development of examination stress scale for junior high school students. Psychological Testing, 60(2), 291-318.】
- 侯傑泰、何穎欣（2008）。學習回饋及系統監察：香港的經驗。教育研究與發展期刊，4（4），1-18。 【Hau, K.-T., & Ho, J. W. Y. (2008). Feedback and system monitoring of students learning: The Hong Kong experience. Journal of Education Research and Development, 4(4), 1-18.】
- 張鎮華（2017）。數學學科知識也是數學素養（數學素養系列之3）。高中數學學科中心電子報，123。https://ghresource.mt.ntnu.edu.tw/uploads/1644995378956mONmCFXd.pdf 【Chang, G.-J. (2017). Fundamental mathematical knowledge is also part of mathematical literacy (Mathematical Literacy- Part 3). The Newsletter of Mathematics Education Resource Center, 123. https://ghresource.mt.ntnu. edu.tw/uploads/1644995378956mONmCFXd.pdf】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2014）。教育會考與國中基測比較表。https://cap.rcpet.edu.tw/background.html 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2014). The comparison and contrast chart between Comprehensive Assessment Program for Junior High School Students and the Basic Competence Test for Junior High School Students. https://cap.rcpet.edu.tw/background.html】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2016）。105年國中教育會考學力品質分析報告。作者。 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2016). The analysis report of 2016 Comprehensive Assessment Program for Junior High School Students. Author.】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2017）。106年國中教育會考學力品質分析報告。作者。 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2017). The analysis report of 2017 Comprehensive Assessment Program for Junior High School Students. Author.】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2018a）。數學科考試內容。https://cap.rcpet. edu.tw/test_4_4.html 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2018a). Test specifications for the math test of the Comprehensive Assessment Program for Junior High School Students. https://cap.rcpet.edu.tw/test_4_4.html】
- 國立臺灣師範大學心理與教育測驗研究發展中心（2018b）。107年國中教育會考計分結果。https://ws.moe.edu.tw/Download.ashx?icon=..pdf&n=C612F6AOBC465D295A8E86BC9517043148B69F091504934381EA5F093DCCOD269DD10A5168B73EB1&u=C099358C81D4876C725695F2070B467E8B81ED614D7AF43EF5976C55CFC16E859844CB6EF80A45A2B1FC5A61A286592CCDCDBFDC3EF4C291B8073738BE2FC398F87CDOA27858A326CF48397566DA1298 【The Research Center for Psychological and Educational Testing, National Taiwan Normal University. (2018b). The results of 2018 Comprehensive Assessment Program for Junior High School Students. https://ws.moe.edu.tw/ Download.ashx?icon=..pdf&n=C612F6AOBC465D295A8E86BC9517043148B69F091504934381EA5F093DCCOD269DD10A5168B73EB1&u=C099358C81D4876C725695F2070B467E8B81ED614D7AF43EF5976C55CFC16E859844CB6EF80A45A2B1FC5A61A286592CCDCDBFDC3EF4C291B8073738BE2FC398F87CDOA27858A326CF48397566DA1298】
- 教育部（2017）。國民中小學成績評量準則。https://law.moj.gov.tw/LawClass/LawAll.aspx?pcode= H0070019 【Ministry of Education. (2017). Assessment criteria for high school and elementary school students. https://law. moj.gov.tw/LawClass/LawAll.aspx?pcode=H0070019】
- 教育部（2018）。十二年國民基本教育課程綱要國民中小學暨普通型高級中等學校─數學領域。https://cirn.moe.edu.tw/Upload/file/27338/72246.pdf 【Ministry of Education. (2018). Twelve-year compulsory education curriculum outline of language area— Mathematic. https://cirn.moe.edu.tw/Upload/file/27338/72246.pdf】
- 曾芬蘭、游羽萱、蔡逸凡、陳柏熹（2019）。國中教育會考英語科聽力測驗實施的回沖效應。教育科學研究期刊，64（2），219-252。https://doi.org/10.6209/JORIES.201906_64(2).0008 【Tseng, F.-L., You, Y.-X., Tsai, I.-F., & Chen, P.-H. (2019). A pilot study of the washback effect of the incorporation of English listening test in the comprehensive assessment program for junior high school students. Journal of Research in Education Sciences, 64(2), 219-252. https://doi.org/10.6209/JORIES.201906_64(2).0008】
- 廖佩莉（2013）。倒流效應：香港全港性系統評估（TSA）對小學中國語文科教師的影響。教育研究月刊，228，86-102。https://doi.org/10.3966/168063602013040228007 【Liu, P.-L. (2013). The washback: The impact of the Hong Kong Territory-wide System Assessment (TSA) on primary Chinese language teachers. Journal of Education Research, 228, 86-102. https://doi.org/10.3966/ 168063602013040228007】
- Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129. https://doi.org/10.1093/applin/14.2.115
- Andrews, S., Fullilove, J., & Wong, Y. (2002). Targeting washback: A case-study. System, 30(2), 207-223. https://doi.org/10.1016/S0346-251X(02)00005-2
- Au, W. (2011). Teaching under the new Taylorism: High‐stakes testing and the standardization of the 21st century curriculum. Journal of Curriculum Studies, 43(1), 25-45. https://doi.org/10. 1080/00220272.2010.521261
- Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education, 11(1), 38-54. https://doi.org/10.1080/09500789708666717
- Cheng, L., & Curtis, A. (2004). Washback or backwash: A review of the impact of testing on teaching and learning. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 37-50). Lawrence Erlbaum Associates.
- Hughes, A. (2003). Testing for language teachers. Cambridge University Press. https://doi.org/10. 1017/CBO9780511732980
- Lam, H. P. (1994). Methodology washback an insider’s view. In D. Nunan, R. Berry, & V. Berry (Eds), Bringing about change in language education: Proceedings of the international language in education conference 1994 (pp. 83-103). University of Hong Kong.
- Mulvenon, S. W., Stegman, C. E., & Ritter, G. (2005). Test anxiety: A multifaceted study on the perceptions of teachers, principals, counselors, students, and parents. International Journal of Testing, 5(1), 37-61. https://doi.org/10.1207/s15327574ijt0501_4
- Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256. https://doi.org/10.1177/026553229601300302
- Pearson, I. (1988). Tests as levers for change (or “putting first things first”). In D. Chamberlain & R. Baumgartner (Eds.), ESP in the classroom: Practice and evaluation (pp. 98-107). Modern English Publications in Association with the British Council.
- Ritt, M. (2016). The impact of high-stakes testing on the learning environment. Master of Social Work Clinical Research, 658. http://sophia.stkate.edu/msw_papers/658
- Rodríjuez-Muñiz, L. J., Díaz, P. Mier, V., & Alnoso, P. (2016). Washback effect of university entrance exams in applied mathematics to social sciences. PLoS ONE, 11(12), e0167544. https://doi.org/10.1371/journal.pone.0167544
- Shohamy, E., Donitsa-Schmidt, S., & Ferman, L. (1996). Test impact revisited: Washback effect over time. Language Testing, 13(3), 298-317. https://doi.org/10.1177/026553229601300305
- Sung, Y.-T., Chao, T.-Y., & Tseng, F.-L. (2016). Reexamining the relationship between test anxiety and learning achievement: An individual-differences perspective. Contemporary Educational Psychology, 46, 241-252.
- Watanabe, Y. (1996). Investigating washback in Japanese EFL classrooms: Problems of methodology. In G. Wigglesworth & C. Elder (Eds.), The language testing circle: From inception to washback (pp. 208-239). Applied Linguistics.
- Wren, D. G., & Benson, J. (2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety, Stress, and Coping, 17(3), 227-240. https://doi.org/10. 1080/10615800412331292606
| 中文APA引文格式 | 張銘秋、黃瓅瑩、陳佳蓉、陳柏熹、曾芬蘭（2022）。國中教育會考數學科的回沖效應初探。教育科學研究期刊，67（1），227-254。https://doi.org/10.6209/JORIES.202203_67(1).0008 |
|---|
| APA Format | Chang, M.-C., Huang, L.-Y., Chen, C.-J., Chen, P.-H., & Tseng, F.-L. (2022). Washback Effect From Changes to Comprehensive Assessment Program Math Test for Junior High School Students. Journal of Research in Education Sciences, 67(1), 217-243. https://doi.org/10.6209/JORIES.202203_67(1).0008 |
|---|
Journal directory listing - Volume 67 (2022) - Journal of Research in Education Sciences【67(1)】March
Directory
Washback Effect From Changes to Comprehensive Assessment Program Math Test for Junior High School Students
Author: Ming-Chiu Chang (Research Center for Psychological and Educational Testing, National Taiwan Normal University), Li-Ying Huang (Research Center for Psychological and Educational Testing, National Taiwan Normal University), Chia-Jung Chen (Research Center for Psychological and Educational Testing, National Taiwan Normal University), Po-Hsi Chen (Department of Educational Psychology and Counseling, Research Center for Psychological and Educational Testing and Institute for Research Excellence in Learning Sciences, National Taiwan Normal University), Fen-Lan Tseng (Research Center for Psychological and Educational Testing and Institute for Research Excellence in Learning Sciences, National Taiwan Normal University)
Vol.&No.：Vol. 67, No. 1
Date：March 2022
Pages：227-254
DOI：https://doi.org/10.6209/JORIES.202203_67(1).0008
Abstract：
Purpose
This study investigated the effects of incorporating constructed-response items into the math tests in Taiwan’s Comprehensive Assessment Program for Junior High School Students (CAP). Using questionnaires, this study explored the differences in junior high school math teachers’ overall approaches to teaching and compared the assessment approaches used in preparation for the Basic Competence Test for Junior High School Students (BCT) with those used for the CAP.
Literature Review
2.1 Washback Effect
Hughes (2003) defined the washback effect as the effect of a test on teaching and learning, which may be positive or negative. Studies on the washback effect have been classroom centered, focusing on the curriculum, materials, pedagogy, assessments, feelings, and attitudes.
2.2 Possible Effect of Adjusting the CAP
The purposes of the CAP and BCT are different; therefore, the functions of the exams, scoring methods, types of test items, test times, and presentation of the test results differ. For a comparison of the CAP and BCT, please refer to the CAP website (https://cap.rcpet.edu.tw/index.html).
The goal of adding constructed-response items to the CAP math test was to induce positive measurement-directed instruction, with the expectation that teachers would adjust their teaching and assessment methods according to the type of items on the CAP. The Ministry of Education, county and municipal education bureaus, and junior high schools attach great value to the CAP results; thus, teachers must respond to the expectations of school authorities and use various strategies to help students prepare for the examination, which may put pressure on teachers.
Therefore, although the CAP has been administered for many years, whether math teachers can select appropriate and diverse forms of assessment in their regular teaching in response to the incorporation of constructed-response items is worth exploring.
Methods
3.1 Participants and Procedure
A survey was conducted with an online questionnaire, which was sent to all junior high schools, and three math teachers from each school were selected to complete the survey. After completing a general math teacher questionnaire, teachers with more than 5 years’ teaching experience were asked to complete a math backwash questionnaire to ensure that those completing the questionnaire had teaching experience related to both the BCT and CAP.
3.2 Measures
This study used two types of teacher questionnaire and semistructured in-depth interviews as follows:
(1) Questionnaire on the washback effect of the math test: This questionnaire had eight items and 35 subitems mainly investigating the curriculum, teaching materials, pedagogy, and assessment used by math teachers in preparation for the BCT and CAP.
(2) General math teacher questionnaire: This questionnaire surveyed teachers’ opinions regarding the CAP and their use of the Feedback “Report on Monitoring the Academic Quality of the CAP” in each school.
(3) Semistructured in-depth interviews: Nine junior high school math teachers were asked in semistructured interviews for their comments on the results of the first two questionnaires.
Results
(1) Approximately 70% of the teachers stated that they would spend more time on the instruction of test content covered by the BCT and CAP.
(2) The teachers used textbooks as the main source of instruction for both exams, with additional practice of constructed-response items and sample questions from previous exams for the CAP (approximately 7.5% higher).
(3) Most teachers used one-way lectures or two-way teacher-student techniques to prepare students for both exams.
(4) The teachers placed the greatest emphasis on reading comprehension skills for the CAP, followed by communication skills.
(5) No significant difference was detected in the proportions of item formats on regular midterm and final exams, even with the slight increase in constructed-response items.
(6) Over 50% of the teachers thought the change from a norm-referenced to a criterion-referenced scoring system would not reduce students’ test anxiety, and nearly 70% of the teachers believed that the new scoring system would reduce learning motivation.
The findings of our study indicate a washback effect from the incorporation of constructed-response items into the CAP math test in junior high school math classes.
Conclusions and Suggestions
5.1 Conclusions
The characteristics of the math teachers’ preparation for the CAP and BCT are compared as follows:
(1) As the CAP items became more authentic and competency-based, teachers placed more emphasis on students’ reading comprehension skills.
(2) The addition of constructed-response items to the CAP led to adjustments in the types of test items and scoring methods used by teachers, with a greater emphasis on constructed-response items; this emphasis on constructed-response items was reflected in the teaching content.
Although the BCT contains no constructed-response items, most teachers nevertheless prepare students for this type of item; regular assessments now include constructed-response items. Such changes in the content of instruction achieve the intended purposes of adding constructed-response items to the test, that is, to guide teachers’ instruction, strengthen students’ ability to communicate and express themselves in math, and make students’ learning of math more comprehensive.
5.2 Suggestions
(1) Teachers should use the data from CAP test reports effectively to identify the test items on which students performed the most poorly and to further understand students’ learning blind spots.
(2) In addition to teaching mathematical knowledge, teachers should strengthen students’ reading comprehension and communication skills to enhance their mathematical literacy.
(3) To enhance the learning motivation of basic level students, a certain percentage of basic or easy items can be used in class to build confidence. Learning activities can be arranged in accordance with student abilities so that students of different ability levels can experience success in math.
Keywords：washback effect, high-stakes test, the Comprehensive Assessment Program for Junior High School Students (CAP), mathematic constructed-response items