Journal directory listing - Volume 66 (2021) - Journal of Research in Education Sciences【66(3)】September

Effects of Item Type on Student Mathematics Performance: Similar Figures as an Example Author: Chien-Heng Chen (Taipei Municipal DaLi High School), Kai-Lin Yang (Department of Mathematics, National Taiwan Normal University)

Vol.&No.:Vol. 66, No. 3
Date:September 2021
Pages:247-277
DOI:https://doi.org/10.6209/JORIES.202109_66(3).0008

Abstract:
    This study investigated the influence of item type on the difficulty and discriminatory power of items and on ninth graders’ mathematics performance. Researchers tested similar figures as competence indicators; three tests were designed with multiple-choice items, completion items, and essay items that corresponded to the same stem, and six common items were equated for each test. The tests were administered to 1,150 students, with 361, 411, and 378 receiving different kind of three tests. The tests were equated using a common-item, nonequivalent group design and the concurrent-calibration method.
    The difficulty and discriminatory power of items and the ability parameters of the students taking the tests with different item types were estimated with a unidimensional two-parameter partial-credit model and a multidimensional latent regression model. The estimates of the students’ ability parameters were converted to percentile ranks (PRs). The following are the results of the study: (1) The average difficulty of the multiple-choice items was the lowest, and that of the essay items was the highest. (2) The average discriminatory power of the multiple-choice items was the lowest, and that of the essay items was the highest. (3) For 69.04% of the students, the values of three item types differed by 20 or more in PR. (4) Finally, the multidimensional latent regression model revealed that, for 12.61% of the students, the values of three item types differed by 15 or more in PR. 
    The results indicate that item type is related to student mathematics performance through two main types of effect. The researchers further investigated why some students’ performance on the completion and essay items was superior to that on the multiple-choice items and why some students’ performance on the multiple-choice items was superior to that on the essay items.

Keywords:similar figure, test equating, item-response theory, item type

《Full Text》 檔名

References:
  1. 大學入學考試中心(2011)。指定科目考試數學考科考試說明(適用99課綱)。https://www.ceec.edu.tw/files/file_pool/1/0J052618615204795377/03-102指考數學考試說明_定稿_.pdf 【College Entrance Examination Center. (2011). Introduction of advanced subjects test mathematics (99 education curricula). https://www.ceec.edu.tw/files/file_pool/1/0J052618615204795377/03-102指考數學考試說明_定稿_.pdf】
  2. 王文中、呂金燮、吳毓瑩、張郁雯、張淑慧(1999)。教育測驗與評量─教室學習觀點。五南。 【Wang, W.-C., Lu, C.-H., Wu, Y.-Y., Chang, Y.-W., & Chang, S.-H. (1999). Educational testing and assessment: The point of view on class learning. Wu-Nan.】
  3. 余民寧(2002)。教育測驗與評量─成就測驗與教學評量。心理。 【Yu, M.-N. (2002). Educational testing and assessment: Achievement test and instructional evaluation. Psychological.】
  4. 余民寧(2009)。試題反應理論(IRT)及其應用。心理。 【Yu, M.-N. (2009). Item Response Theory and application. Psychological.】
  5. 吳宜靜(2005)。八二年版國一學生縮圖與放大圖繪製之概念與表現(未出版碩士論文)。國立臺南大學。 【Wu, Y.-C. (2005). The concept and performance on both reduced and enlarged graphs of seventh grade students [Unpublished master’s thesis]. National University of Tainan.】
» More
APA FormatChen, C.-H., & Yang, K.-L. (2021). Effects of item type on student mathematics performance: Similar figures as an example. Journal of Research in Education Sciences, 66(3), 247-277. https://doi.org/10.6209/JORIES.202109_66(3).0008