Elementary school teachers’ identification ability and perceptions of hots mathematics items
DOI:
Keywords:
elementary school teachers, HOTS, item identification, rasch model teacher perceptionsAbstract
Despite widespread policy emphasis on Higher Order Thinking Skills (HOTS) in elementary mathematics education, prior research has predominantly focused on teachers' declarative perceptions, leaving open the question of whether they can reliably identify HOTS items in practice. This gap between endorsing HOTS in principle and demonstrating operational competence represents a critical yet underexplored dimension of teacher assessment literacy. This study examines elementary school teachers' ability to identify HOTS mathematics items and investigates the relationship between their perceptions and identification performance. A descriptive quantitative approach was employed with 52 elementary school teachers in West Java, Indonesia, selected through purposive sampling. Data were collected using a performance-based HOTS item-identification test, a Rasch model analysis, and a teacher-perception questionnaire. Although teachers generally held positive perceptions of HOTS, no significant relationship was found between perception scores and identification ability (ρ = −0.061, p = .666), indicating that favorable attitudes do not necessarily translate into operational competence. Rasch analysis further revealed a tendency among teachers to conflate procedural complexity with genuine cognitive demand, as reflected in item misfit patterns. Teachers who had received HOTS training demonstrated higher identification ability than those without such training, whereas teaching experience revealed no significant effect. These findings highlight a gap between declarative knowledge and operational skill and call for competency-based HOTS training in elementary teacher professional development, while demonstrating the value of integrating performance-based assessment with psychometric modeling to strengthen teacher assessment literacy.
References
Ali, S. S., Saleem, A., & Dogar, A. H. (2022). Integration of higher order thinking skills with content: A continuous professional development perspective for teachers in Pakistan. Journal of Education and Educational Development, 9(1), 92–108. https://doi.org/10.22555/joeed.v9i1.531
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
Ariawan, M., & Pratiwi, E. (2017). Analisis kemampuan guru SD dalam penerapan pembelajaran berbasis HOTS. Jurnal Pendidikan Dan Pembelajaran, 4(3), 231–239.
Azid, N., Hoe, L. S., & Hasim, S. M. (2022). Challenges in implementing higher order thinking skills in teaching and learning of mathematics: A systematic review. Journal of Educational Research and Indigenous Studies, 1(1), 1–12.
Bailes, L. P., & Nandakumar, R. (2020). Using the Rasch model to evaluate teacher knowledge assessments. Educational and Psychological Measurement, 80(5), 990–1014. https://doi.org/10.1177/0013164420906600 DOI: https://doi.org/10.1177/0013164420906600
Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551–575. https://doi.org/10.1080/0969594X.2018.1441807 DOI: https://doi.org/10.1080/0969594X.2018.1441807
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
Dewi, T. M., & Meilina, F. (2022). PENGEMBANGAN LEMBAR KERJA PESERTA DIDIK (LKPD) BERBASIS HIGHER ORDER THINKING SKILL (HOTS) TERINTEGRASI WEB PADA PEMBELAJARAN IPA DI SEKOLAH DASAR. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 11(5), 1368. https://doi.org/10.33578/jpfkip.v11i5.9106 DOI: https://doi.org/10.33578/jpfkip.v11i5.9106
Edelsbrunner, P. A., Schalk, L., Schumacher, R., & Stern, E. (2024). Variability of teacher assessment competence: A latent state-trait analysis. Journal of Educational Psychology, 116(1), 43–62. https://doi.org/10.1037/edu0000819 DOI: https://doi.org/10.1037/edu0000887
Fazilla, S., & Siregar, P. H. (2023). Analysis of Higher-Order-Thinking Skill (HOTS) Questions in the Class V Elementary Student’s Books Theme 3. 12.
Gordon, S. P., Dembo, M. H., & Hocevar, D. (2021). Using Rasch measurement to examine the psychometric properties of the Teacher Efficacy Scale. Educational and Psychological Measurement, 81(5), 1007–1034.
Hagell, P., & Westergren, A. (2016). Sample Size and Statistical Conclusions from Tests of Fit to the Rasch Model According to the Rasch Unidimensional Measurement Model (Rumm) Program in Health Outcome Measurement. Journal of Applied Measurement, 17(4), 416–431.
Herawati, E. (2021). Analysis of elementary school teachers’ perceptions toward higher-order thinking skills assessment in mathematics. Journal of Elementary Education, 14(3), 287–302.
Herawati, N. (2021). KEMAMPUAN GURU DALAM MEMBUAT SOAL HOTS DALAM UJIAN TENGAH SEMESTER. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 10(6), 1689. https://doi.org/10.33578/jpfkip.v10i6.8638 DOI: https://doi.org/10.33578/jpfkip.v10i6.8638
Isrokatun, I., Destrinelli, D., & Setyaningrum, W. (2023). Analysis of HOTS-based mathematics assessment items in elementary school textbooks. International Journal of Elementary Education, 7(2), 215–228. https://doi.org/10.23887/ijee.v7i2.45621
Isrokatun, I., Marlina, R., & Pujianto, A. (2024). Teachers’ understanding and readiness in implementing HOTS-based mathematics assessment in Indonesian elementary schools. Pegem Journal of Education and Instruction, 14(1), 125–138.
Jannah, F., Radiansyah, R., Sari, R., Kurniawan, W., Aisyah, S., Wardini, S., & Fahlevi, R. (2022). PEMBELAJARAN HOTS BERBASIS PENDEKATAN LINGKUNGAN DI SEKOLAH DASAR. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 11(1), 189. https://doi.org/10.33578/jpfkip.v11i1.8533 DOI: https://doi.org/10.33578/jpfkip.v11i1.8533
Khaesarani, I. R., & Ananda, R. (2022). Students’ mathematical literacy skills in solving higher-order thinking skills problems. Al-Jabar : Jurnal Pendidikan Matematika, 13(1), 81–99. https://doi.org/10.24042/ajpm.v13i1.11499 DOI: https://doi.org/10.24042/ajpm.v13i1.11499
Koh, K., Burke, L. E. C., Luke, A., Gong, W., & Tan, C. (2025). Developing assessment literacy: An analysis of teacher learning through collaborative assessment design. Assessment in Education: Principles, Policy & Practice, 32(1), 78–96. https://doi.org/10.1080/0969594X.2024.2301234
Koh, K., Burke, L. E. C.-A., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366 DOI: https://doi.org/10.1177/1362168816684366
Linacre, J. M. (2023). Winsteps® Rasch measurement computer program (Version 5.4.0) [Computer software]. Winsteps.com.
Makhmetova, Z., Karabassova, L., Zhakim, A., & Karinov, A. (2025). Exploring the Effects of Professional Learning Experiences on In-Service Teachers’ Growth: A Systematic Review of Literature. Education Sciences, 15(2), 146. https://doi.org/10.3390/educsci15020146 DOI: https://doi.org/10.3390/educsci15020146
Maryono, M., Sastrawati, E., & Budiono, H. (2022). ANALISIS KESULITAN GURU SEKOLAH DASAR DALAM MENGEMBANGKAN INSTRUMEN ASESMEN HIGHER ORDER THINGKING SKILLS. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 11(5), 1529. https://doi.org/10.33578/jpfkip.v11i5.9182 DOI: https://doi.org/10.33578/jpfkip.v11i5.9182
Nirtha, I. N., Marhaeni, A. A. I. N., & Suastra, I. W. (2024). Elementary school teachers’ perceptions and practices in implementing higher-order thinking skills in mathematics learning. Journal of Education Research and Evaluation, 8(1), 45–58.
Noben, I., Maulana, R., Deinum, J. F., & Hofman, W. H. A. (2021). Measuring university teachers’ teaching quality: A Rasch modelling approach. Learning Environments Research, 24(1), 87–107. https://doi.org/10.1007/s10984-020-09319-w DOI: https://doi.org/10.1007/s10984-020-09319-w
O’Neill, T. R., Gregg, J. L., & Peabody, M. R. (2020). Effect of Sample Size on Common Item Equating Using the Dichotomous Rasch Model. Applied Measurement in Education, 33(1), 10–23. https://doi.org/10.1080/08957347.2019.1674309 DOI: https://doi.org/10.1080/08957347.2019.1674309
Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2), 020111–020111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111 DOI: https://doi.org/10.1103/PhysRevPhysEducRes.15.020111
Qirom, M. S., & Nurlaelah, E. (2023). Rasch Model: Analysing the Items Quality of Mathematics Higher-Order Thinking Skill Instrument. JPP (Jurnal Pendidikan Dan Pembelajaran); Vol 30, No 1 (2023)DO - 10.17977/Um047v30i12023p8-16. https://journal2.um.ac.id/index.php/jpp/article/view/32165
Retnawati, H., Djidu, H., Kartianom, Apino, E., & Anazifa, R. D. (2018). TEACHERS’ KNOWLEDGE ABOUT HIGHER-ORDER THINKING SKILLS AND ITS LEARNING STRATEGY. In Problems of Education in the 21st Century (Vol. 76, p. Continuous). https://doi.org/https://doi.org/10.33225/pec/18.76.215 DOI: https://doi.org/10.33225/pec/18.76.215
Retnawati, H., Sulistyaningsih, E., & Yin, L. Y. (2018). Students’ readiness to teaching practice experience: A review from the mathematics education students’ view. Jurnal Riset Pendidikan Matematika, 5(1), 1–17. https://doi.org/10.21831/jrpm.v5i1.18788 DOI: https://doi.org/10.21831/jrpm.v5i1.18788
Sahippudin, S. (2021). UPAYA KEPALA SEKOLAH MELALUI SUPERVISI DALAM MENINGKATKAN KREATIVITAS GURU DALAM PEMBELAJARAN DARING DI SDN 022 HARAPAN BARU. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 10(6), 1547. https://doi.org/10.33578/jpfkip.v10i6.8607 DOI: https://doi.org/10.33578/jpfkip.v10i6.8607
Schoenfeld, A. H. (2016). Learning to Think Mathematically: Problem Solving, Metacognition, and Sense Making in Mathematics (Reprint). Journal of Education, 196(2), 1–38. https://doi.org/10.1177/002205741619600202 DOI: https://doi.org/10.1177/002205741619600202
Shamsuddin, H., Abdul Razak, N., & Zamri Khairani, A. (2018). Calibrating Studentsâ€TM Performance in Mathematics: A Rasch Model Analysis. International Journal of Engineering and Technology, 7(3.20), 109–113. https://doi.org/10.14419/ijet.v7i3.20.18991 DOI: https://doi.org/10.14419/ijet.v7i3.20.18991
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada assessment pendidikan [Application of Rasch modeling in educational assessment]. Trim Komunikata.
Thompson, P. W. (2017). Problems, Theories, and the Common Core. Journal for Research in Mathematics Education, 48(1), 2–6. https://doi.org/10.5951/jresematheduc.48.1.0002 DOI: https://doi.org/10.5951/jresematheduc.48.1.0002
van de Grift, W. J. C. M., Houtveen, T. A. M., van den Hurk, H. T. G., & Terpstra, O. (2019). Measuring teaching skills in elementary education using the Rasch model. School Effectiveness and School Improvement, 30(4), 455–486. https://doi.org/10.1080/09243453.2019.1577743 DOI: https://doi.org/10.1080/09243453.2019.1577743
Wakhata, R., Mutarutinya, V., & Balimuttajjo, S. (2023). Exploring the impact of Stein et al.’s levels of cognitive demand in supporting students’ mathematics heuristic problem-solving abilities. Frontiers in Education, Volume 8-2023. https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2023.949988 DOI: https://doi.org/10.3389/feduc.2023.949988
Warsudi, W. (2022). KEMAMPUAN GURU DALAM MEMBUAT SOAL UJIAN SEMESTER DI SDN 025 HARAPAN JAYA. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 11(1), 138. https://doi.org/10.33578/jpfkip.v11i1.8766 DOI: https://doi.org/10.33578/jpfkip.v11i1.8766
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010 DOI: https://doi.org/10.1016/j.tate.2016.05.010
Zhou, D., Liu, J., & Liu, J. (2023). Assessment design for learning: The role of HOTS items in promoting mathematical reasoning. Educational Assessment, Evaluation and Accountability, 35(3), 289–312. https://doi.org/10.1007/s11092-023-09415-x
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Briliian Prisillia, Dinie Anggraeni Dewi, Deni Darmawan (Author)

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Licence
Copyright @2017. This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (http://creativecommons.org/licenses/by-nc-sa/4.0/) which permits unrestricted non-commercial used, distribution and reproduction in any medium
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.