Adaptation and Validation of a Four-Tier Misconception Diagnostic Test on Work and Energy Using Rasch Modeling

Gress Faihah; Moh. Irma Sukarelawan; Toni Kus Indratno

doi:10.20527/jipf.v9i3.16781

Adaptation and Validation of a Four-Tier Misconception Diagnostic Test on Work and Energy Using Rasch Modeling

Gress Faihah, Moh. Irma Sukarelawan, Toni Kus Indratno

Abstract

The WPECT instrument has been globally tested for its quality in diagnosing student misconceptions. However, this instrument cannot be directly used in the Indonesian cultural context due to language differences. Therefore, a cross-cultural adaptation process is required. This study aims to adapt and cross-culturally validate a four-tier diagnostic test on the concepts of Work, Power, and Energy using the Rasch model (1PL) based on item difficulty estimation. The research was conducted using a quantitative survey method involving 125 students from SMA Negeri 1 Jetis. The focus of the study is to adapt and validate the 4-tier Work, Power, and Energy instrument to the Indonesian context. The analysis results show that the item reliability index is 0.87 and the Cronbach's Alpha is 0.81, indicating a high level of internal consistency within the instrument. The distribution of item difficulty is spread across four categories, with the majority of items classified as difficult. Twelve out of thirteen items meet the Rasch model fit criteria, while one item can still be retained as its outfit MNSQ value remains below the acceptable threshold (< 2.0). The instrument also fulfills the assumption of unidimensionality, as all 13 items measure a single underlying construct—namely, the concept of work, power, and energy. Furthermore, no gender-based item bias was detected. Therefore, the four-tier diagnostic test on the topic of work and energy is suitable for identifying misconceptions among high school students in Indonesia, validly and equitably. The availability of this adapted instrument can help educators in Indonesia more accurately diagnose student misconceptions and design more targeted instructional interventions.

Keywords

I-WPECT; Cross-cultural adaptation; Instrument validation; Four-tier test; Rasch model

Full Text:

PDF

References

Alnahdi, A. H., Alsubiheen, A. M., & Aldaihan, M. M. (2025). Rasch measurement model supports the unidimensionality and internal structure of the arabic oswestry disability index. Journal of Clinical Medicine, 14(4), 1259. https://doi.org/10.3390/jcm14041259

Anggrayni, S., & Ermawati, F. U. (2019). The validity of Four-Tier’s misconception diagnostic test for Work and Energy concepts. Journal of Physics: Conference Series, 1171, 012037. https://doi.org/10.1088/1742-6596/1171/1/012037

Aqida, D. S., Destia Khairunisa, Meisya, R., & Jannah, R. (2023). The use of rasch model in analyzing grade v elementary school mathematics items. Sunan Kalijaga International Journal on Islamic Educational Research, 7(1), 57–67. https://doi.org/10.14421/skijier.2023.71.06

Aripiani, S. K., Samsudin, A., Kaniawati, I., Novia, H., Aminudin, A. H., Sutrisno, A. D., & Coştu, B. (2023). Diagnostic instruments of four-tier test work and energy (fortune) to identify the level of students’ conceptions. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah, 8(1), 19–32. https://doi.org/10.24042/tadris.v8i1.13524

Aziz, K. A., Jabar, M. A., Abdullah, S., & Nor, R. N. H. (2022). Assessing factors influencing internet banking adoption by using rasch model measurement. Bulletin of Electrical Engineering and Informatics, 11(4), 2313–2321.

https://doi.org/10.11591/eei.v11i4.3761

Bawamenewi, A. (2024). Analisis miskonsepsi siswa kelas x sma di kota padang tentang materi hukum newton dengan menggunakan tes diagnostik four-tier multiple choice. Physics Learning and Education, 2(2), 89–96. https://doi.org/10.24036/ple.v2i2.120

Bentaleb, K. A., Dachraoui, S., Hassouni, T., Alibrahmi, E. mehdi, Chakir, E., & Belboukhari, A. (2022). Development of a survey to assess conceptual understanding of quantum mechanics among moroccan undergraduates. European Journal of Educational Research, volume-11-(volume-11-issue-4-october-2022), 2219–2243. https://doi.org/10.12973/eu-jer.11.4.2219

Cerri, L. Q., Justo, M. C., Clemente, V., Gomes, A. A., Pereira, A. S., & Marques, D. R. (2023). Insomnia Severity Index: A reliability generalisation meta‐analysis. Journal of Sleep Research, 32(4), 1–12. https://doi.org/10.1111/jsr.13835

Fenditasari, K., Jumadi, Istiyono, E., & Hendra. (2020). Identification of misconceptions on heat and temperature among physics education students using four-tier diagnostic test. Journal of Physics: Conference Series, 1470(1), 012055. https://doi.org/10.1088/1742-6596/1470/1/012055

Fuchs, T. T., Bonney, K. M., & Arsenault, M. (2021). Leveraging student misconceptions to improve teaching of biochemistry & cell biology. The American Biology Teacher, 83(1), 5–11. https://doi.org/10.1525/abt.2021.83.1.5

Härmälä-Braskén, A.-S., Hemmi, K., & Kurtén, B. (2020). Misconceptions in chemistry among Finnish prospective primary school teachers – a long-term study. International Journal of Science Education, 42(9), 1447–1464.

https://doi.org/10.1080/09500693.2020.1765046

Hayat, B., Putra, M. D. K., Rahmawati, R., & Isa, K. (2023). Rasch calibration and differential item functioning (dif) analysis of the indonesian national assessment program-language (INAP-L). World Journal of English Language, 13(6), 402. https://doi.org/10.5430/wjel.v13n6p402

Irmak, M., İnaltun, H., Ercan-Dursun, J., Yaniş-Kelleci, H., & Yürük, N. (2023). Development and application of a three-tier diagnostic test to assess pre-service science teachers’ understanding on work-power and energy concepts. International Journal of Science and Mathematics Education, 21(1), 159–185. https://doi.org/10.1007/s10763-021-10242-6

Karlimah, K. (2022). How does Rasch modeling reveal difficulty and suitability level the fraction test question? Jurnal Elemen, 8(1), 66–76. https://doi.org/10.29408/jel.v8i1.4170

Kurniawan, A., Istiyono, E., & Naba, S. D. (2024). Item quality

analysis of physics concept understanding test with rasch model. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(3), 474. https://doi.org/10.26737/jipf.v9i3.5692

Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions. https://www.rasch.org/rmt/rmt74m.htm

Linacre, J. M. (2021). Winsteps® (Version 4.6.1) [Computer Software]. http://www.winsteps.com

Lv, Q., Zhang, X., Wang, Y., Xu, X., & Zang, X. (2024). Cross-cultural adaptation and validation of the caregiver self-efficacy in contributing to patient self-care scale in China. BMC Public Health, 24(1), 1977. https://doi.org/10.1186/s12889-024-19534-2

Maison, Asrial, Susanti, N., Effrita, A., & Tanti. (2021). Identification of students’ misconception about light using a four-tier instrument. Journal of Physics: Conference Series, 1876(1), 012063. https://doi.org/10.1088/1742-6596/1876/1/012063

Mbonyiryivuze, A., Yadav, L. L., & Amadalo, M. M. (2019). Students’ conceptual understanding of electricity and magnetism and its implications: A review. African Journal of Educational Studies in Mathematics and Sciences, 15(2), 55–67.

https://doi.org/10.4314/ajesms.v15i2.5

Naingalis, M. L. P., Fauzi, A., Supurwoko, & Sartono, B. (2023). Item fit investigation of computational thinking scales instrument among Indonesian physics undergraduate students: A Rasch model analysis. 090006. https://doi.org/10.1063/5.0105746

Nasir, M., Cari, C., Sunarno, W., & Rahmawati, F. (2023). The development of a two-tier diagnostic test for student understanding of light. Journal of Turkish Science Education, 20(1), 150–172. https://doi.org/10.36681/tused.2023.009

Natsir, I., Mayasari, D., & Munfarikhatin, A. (2022). Rasch model: Quality of test instruments to measure students’ ability in algebra. SHS Web of Conferences, 149, 01033. https://doi.org/10.1051/shsconf/202214901033

Ravish, I. (2025). An analysis of misconceptions in science education: identifying barriers to effective learning and instruction. International Journal of Applied and Behavioral Sciences, 2(1), 199–207. https://doi.org/10.70388/ijabs250119

Reño, A. B. (2024). Rasch analysis in diagnosing learning gaps and gauge item difficulty in eighth-grade mathematics assessments. Pakistan Journal of Life and Social Sciences (PJLSS), 22(2), 14571–14579. https://doi.org/10.57239/PJLSS-2024-22.2.001049

Sari, F. K., Alifiani, A., Nursit, I., Jannah, U. R., & Rahaju, R. (2024). Unveiling hidden misconceptions: A new perspective on first-year students’ algebraic understanding. JME (Journal of Mathematics Education), 9(2), 226–234. https://doi.org/10.31327/jme.v9i2.2231

Sukarelawan, M. I., Indratno, T. K., Oktova, R., & Abdullah, N. S. Y. (2024). Quality of four-tier diagnostic test on wave and vibration materials: An empirical study using rasch modeling. Jurnal Pendidikan Fisika Indonesia, 20(1), 27–37. https://doi.org/10.15294/jpfi.v20i1.47493

Sukarelawan, M. I., Jumadi, J., & Rahman, N. A. (2019). An analysis of graduate students’ conceptual understanding in heat and temperature (h&t) using three-tier diagnostic test. Indonesian Review of Physics, 2(1), 9. https://doi.org/10.12928/irip.v2i1.910

Sukarelawan, M. I., Sa’adah, M., Jupri, J., & Hikmah, F. N. (2024). Is it true that my students don’t understand the static fluid concepts? Rasch modeling perspective. Jurnal Pendidikan dan Pengajaran, 57(1), 127-138.

Sukarelawan, M. I., Sriyanto, S., Puspitasari, A. D., Sulisworo, D., & Hikmah, U. N. (2021). Four-tier heat and temperature diagnostic test (4t-htdt) to identify student misconceptions. JIPFRI (Jurnal Inovasi Pendidikan Fisika Dan Riset Ilmiah), 5(1), 1–8. https://doi.org/10.30599/jipfri.v5i1.856

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada asesmen pendidikan. Trim Komunikata.

Suprapto, N. (2020). Do we experience misconceptions?: An ontological review of misconceptions in science. Studies in Philosophy of Science and Education, 1(2), 50–55. https://doi.org/10.46627/sipose.v1i2.24

Syuhendri, S. (2017). A learning process based on conceptual change approach to foster conceptual change in newtonian mechanics. Journal of Baltic Science Education, 16(2), 228–240. https://doi.org/10.33225/jbse/17.16.228

Syuhendri, S. (2019). Student teachers’ misconceptions about gravity. Journal of Physics: Conference Series, 1185, 012047. https://doi.org/10.1088/1742-6596/1185/1/012047

Syuhendri, S. (2022). Teaching for conceptual change on Newton’s First Law. Journal of Physics: Conference Series, 2165(1), 012036. https://doi.org/10.1088/1742-6596/2165/1/012036

Zayrin, A. A., Nupus, H., Maizia, K. K., Marsela, S., Hidayatullah, R., & Harmonedi, H. (2025). Analisis instrumen penelitian pendidikan (uji validitas dan relibilitas instrumen penelitian). Jurnal QOSIM Jurnal Pendidikan Sosial & Humaniora, 3(2), 780–789. https://doi.org/10.61104/jq.v3i2.1070

DOI: https://doi.org/10.20527/jipf.v9i3.16781