Development and Validation of a Physics Test Instrument to Measure Problem-Solving Skills on Heat Concepts

Adhelia Tasya Youlanda; Mukhayyarotin Niswati Rodliyatul Jauhariyah

doi:10.20527/bipf.v14i2.25819

Development and Validation of a Physics Test Instrument to Measure Problem-Solving Skills on Heat Concepts

Adhelia Tasya Youlanda, Mukhayyarotin Niswati Rodliyatul Jauhariyah

Abstract

This study aims to develop a valid and reliable knowledge test instrument to measure students’ problem-solving skills in heat material. The research employed a research and development approach using the ADDIE development model. The instrument consisted of 10 essay questions constructed based on Polya’s problem-solving indicators. The instrument was validated by three experts, specifically two lecturers in the physics department and one physics teacher, and also tested on thirty-three first-year students enrolled in the Physics Education Study Program at Surabaya State University. The analysis included theoretical validity, empirical validity, reliability, difficulty level, and discrimination power. The results showed that the theoretical validity reached an average Percentage of Agreement (PoA) of 88.09% in the valid category. Empirical validity indicated that all items (100%) were valid with a reliability coefficient of 0.83, indicating high reliability. The difficulty level consisted of 60% easy and 40% moderate items, while the discrimination power showed 10% good and 90% sufficient categories. These findings indicate that the developed instrument is suitable for measuring students’ problem-solving skills in heat material and supporting the assessment of higher-order thinking skills in physics learning.

Keywords

Heat; Physics education; Problem-solving skills; Test instrument; Validity

Full Text:

PDF

References

Adeoye, M. A., & Jimoh, H. A. (2023). Problem-solving skills among 21st-century learners toward creativity and innovation ideas. Thinking Skills and Creativity Journal, 6(1), 52–58. https://doi.org/10.23887/tscj.v6i1.62708

Annam, S., Syuzita, A., Pratiwi, R., & Sarkingobir, Y. (2024). Mapping research trends on 21st-century problem-solving skills in science learning: A literature review from 2014 to 2023. Research in Education, Technology, and Multiculture, 3(1), 52–60. https://doi.org/10.61436/rietm/v3i1.pp52-60

Arikunto, S. (2013). Prosedur penelitian. Jakarta: Rineka Cipta.

Aristiawan, A., & Istiyono, E. (2020). Developing instrument of essay test to measure the problem-solving skill in physics. Jurnal Pendidikan Fisika Indonesia, 16(2), 72–82. https://doi.org/10.15294/jpfi.v16i2.24249

Ayu, G. N., Putri, C. A., Riyanto, A. R., & Koto, I. (2025). The scientific literacy competence of students in indonesia and mexico based on pisa 2022: An international comparative study. TOFEDU: The Future of Education Journal, 4(5), 1033–1038. https://doi.org/10.61445/tofedu.v4i5.525

Bhakti, Y. B., Arthur, R., & Supriyati, Y. (2025). Development of physics hots assessment instruments in high school: A comprehensive literature review. JIPF (Jurnal Ilmu Pendidikan Fisika), 10(2), 194. https://doi.org/10.26737/jipf.v10i2.5962

Borich, G. D., Godbout, R. C., Peck, R. F., Kash, M. M., & Poynor, L. H. (1994). An evaluation of the personalized model of teacher. Research and Development Center for Teacher Education The University of Texas at Austin.

Brookhart, S. M. (2024). Educational Assessment knowledge and skills for teachers revisited. Education Sciences, 14(7). https://doi.org/10.3390/educsci14070751

Brown, B., & Singh, C. (2021). Development and validation of a conceptual survey instrument to evaluate students’ understanding of thermodynamics. Physical Review Physics Education Research, 17(1). https://doi.org/10.1103/PhysRevPhysEducRes.17.010104

Brundage, M. J., Meltzer, D. E., & Singh, C. (2024a). Investigating introductory and advanced students’ difficulties with change in internal energy, work, and heat transfer using a validated instrument. Physical Review Physics Education Research, 20(1). https://doi.org/10.1103/PhysRevPhysEducRes.20.010115

Brundage, M. J., Meltzer, D. E., & Singh, C. (2024b). Investigating introductory and advanced students’ difficulties with entropy and the second law of thermodynamics using a validated instrument. Physical Review Physics Education Research, 20(2), 1–21. https://doi.org/10.1103/PhysRevPhysEducRes.20.020110

Brundage, M. J., & Singh, C. (2023). Development and validation of a conceptual multiple-choice survey instrument to assess student understanding of introductory thermodynamics. Physical Review Physics Education Research, 19(2), 20112. https://doi.org/10.1103/PhysRevPhysEducRes.19.020112

Docktor, J. L., & Mestre, J. P. (2014). A synthesis of discipline-based education research in physics. Physical Review Special Topics-Physics Education Research, 10(Special Topics), 1-148 (020119). https://doi.org/10.1103/PhysRevSTPER.10.020119

Ekawati, E. Y., Azzahra, S. A., & Fithriyah, H. (2024). Construction of critical reasoning skills assessment instruments as diagnostic assessments in physics learning with polytomus scoring. Journal of Education Research and Evaluation, 8(2), 338–349. https://doi.org/10.23887/jere.v8i2.69259

Fadzil, H. M., Saat, R. M., & Rafi, A. (2022). Development of technology-enhanced three-tier diagnostic test to assess pre-university students’ understanding of scientific concepts. Alternative Assessments in Malaysian Higher Education: Voices from the Field, 285–292. https://doi.org/10.1007/978-981-16-7228-6_29

Hadi, H., Juandi, D., & Rusdiana, D. (2023). Problem solving ability analysis: Systematic literature review. Journal of Mathematics and Mathematics Education, 13(1), 33-43. https://doi.org/10.20961/jmme.v13i1.73819

Haris, A., Hasyim, M., Ma’ruf, Halim, A. D., Mahir, & Ramadhan, I. (2025). The effectiveness of dynamic problem-solving strategy and innovative assessment tools to improve students’ higher-order thinking skills. Jurnal Pendidikan IPA Indonesia, 14(1). https://doi.org/10.15294/jpii.v14i1.21433

Hidayati, F., & Julianto, J. (2025). Integrasi pendekatan etnosains dalam pembelajaran sains untuk meningkatkan keterampilan berpikir kritis siswa. DIDAKTIKA : Jurnal Pemikiran Pendidikan, 31(1), 101. https://doi.org/10.30587/didaktika.v31i1.9578

Idrus, T., Pomalato, S. W., Ismail, S., & Mohidin, A. D. (2023). Pengembangan instrumen kemampuan pemecahan masalah matematika peserta didik di sma. Jambura Journal of Mathematics Education, 4(1), 63–74. https://doi.org/10.34312/jmathedu.v4i1.16404

Jatisunda, M. G., Suryadi, D., & Prabawanto, S. (2024). Enhancing mathematical problem-solving ability through project-based learning: A study of vocational high school student. Jurnal Elemen, 10(3), 711–727. https://doi.org/10.29408/jel.v10i3.26244

Khotimah, K., & Fariyani, Q. (2025). Development of a physics assessment instrument to measure high school students multirepresentation skills in momentum and impulse. Impulse: Journal of Research and Innovation in Physics Education, 5(1), 49–61. https://doi.org/10.14421/impulse.2025.51-04

Kusumaningtyas, D. A., Manyunu, M., Kurniasari, E., Awalin, A. N., Rahmaniati, R., & Febriyanti, A. (2024). Enhancing learning outcomes: A study on the development of higher order thinking skills based evaluation instruments for work and energy in high school physics. Indonesian Journal on Learning and Advanced Education

(IJOLAE), 14–31. https://doi.org/10.23917/ijolae.v6i1.23125

Latifah, S., Meisuri, M., & Kesuma, A. A. (2023). Development of physics worksheet based on higher order thinking skills (hots) integrated with bilingual class learning. Indonesian Journal of Science and Mathematics Education, 6(1), 82–95.

Lubis, M. U., Siagian, F. A., Zega, Z., Nuhdin, N., & Nasution, A. F. (2023). Pengembangan kurikulum merdeka sebagai upaya peningkatan keterampilan abad 21 dalam pendidikan. ANTHOR: Education and Learning Journal, 2(5), 691–695. https://doi.org/10.31004/anthor.v1i5.222

Meyer, A., & Friege, G. (2026). An atomized approach to assessing energy problem solving in physics using multidimensional item response theory. Frontiers in Education, 11(February). https://doi.org/10.3389/feduc.2026.1759878

Mufadillah, M., Trimurtini, T., & Supriyanto, T. (2024). Profile of problem-solving skills question story based on the polya model at kampus mengajar partner schools. Numerical: Jurnal Matematika Dan Pendidikan Matematika, 8(1), 187–204. https://doi.org/10.25217/numerical.v8i1.4379

Nabilah, N., Umma, D. K., Nasution, S. M., & Putri, M. D. (2025). Pengembangan instrumen tes essay berbasis kemampuan berpikir kritis materi suhu dan kalor pada pembelajaran ipa di sekolah menengah pertama. Jurnal Inovasi Pendidikan Sains (JIPS), 6(2), 74–81. https://doi.org/10.37729/jips.v6i2.5999

Nisa, K., Putri, S. A., & Kuswanto, H. (2024). A systematic literature review: Problem-solving skills in physics teaching. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 10(1), 173–182. https://doi.org/10.21009/1.10115

Novika, R., Istiyono, E., & Notiavina, A. A. (2025). Developing an assessment instrument to measure the minimum competency of high school physics using item response theory. Jurnal Penelitian Dan Evaluasi Pendidikan, 29(1), 98–113.

https://doi.org/10.21831/pep.v29i1.70700

Nurul, D. (2022). Analisis kesulitan kemampuan pemecahan masalah pada pesera didik dalam pembelajaran fisika. Jurnal Inovasi Dan Teknologi Pendidikan, 1(1), 20–30. https://doi.org/10.46306/jurinotep.v1i1.2

Osborne, J., & Allchin, D. (2025). Science literacy in the twenty-first century: Informed trust and the competent outsider. International Journal of Science Education, 47(15–16), 2134–2155. https://doi.org/10.1080/09500693.2024.2331980

Salim, F., Purwanto, A., & Lestari, I. (2024). Improving students’

science problem solving ability through the implementation of problem based learning models assisted by animation media. International Journal of Elementary Education, 8(2), 269–278. https://doi.org/10.23887/ijee.v8i2.76925

Sanjiartha, I. G. D., Suwindia, I. G., & Winangun, I. M. A. (2024). Peran literasi sains dalam membentuk generasi berfikir kritis dan inovatif: Kajian literature review. Education and Social Sciences

Review, 5(2), 120–128. https://doi.org/10.29210/07essr499900

Setiaji, B., Santoso, P. H., Aziz, K. N., Retnawati, H., & Khairudin, M. (2023). Using multilevel modelling to evaluate science literacy and technology course of the indonesian non-science students. Jurnal Pendidikan IPA Indonesia, 12(1), 96–111. https://doi.org/10.15294/jpii.v12i1.41457

Sherliyanti, Y., & Jauhariyah, M. N. R. (2024). Validitas instrumen penilaian berbasis kelas untuk mengukur kompetensi literasi sains peserta didik pada materi pemanasan global. IPF: Inovasi Pendidikan Fisika, 13(3), 168–176. https://doi.org/10.26740/ipf.v13n3.p168-176

Shofiah, S., Bachtiar, E., & Kd, D. P. (2023). Dasar-dasar evaluasi pembelajaran. Deli Serdang: PT. Mifandi Mandiri Digital.

Simamora, N. N., Istiyono, E., & Wilujeng, I. (2024). Development of an assessment instrument to measure high school students’ collaboration skills in physics learning. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 10(1).

https://doi.org/10.21009/1.10104

Sinaga, B., Sitorus, J., & Situmeang, T. (2023). The influence of students’ problem-solving understanding and results of students’ mathematics learning. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1088556

Sinurat, J. N., Safriana, Ayunda, D. S., Ginting, F. W., & Andriani, R. (2026). Evaluating assessment instruments for measuring students’ higher-order thinking skills in heat and temperature concepts. Jurnal Phi Jurnal Pendidikan Fisika Dan Fisika Terapan, 12(1), 54–65. https://doi.org/10.22373/p-jpft.v12i1.32237

Subhaktiyasa, P. G. (2024). Evaluasi validitas dan reliabilitas instrumen penelitian kuantitatif: sebuah studi pustaka. Journal of Education Research, 5(4), 5599–5609. https://doi.org/10.37985/jer.v5i4.1747

Sukma, M. D. A., Dhiarni, Y. I., Kusniati, R., Wiyatmo, Y., & Kuswanto, H. (2025). Systematic literature review: Analysis of problem-solving skill trends in physics education (2014-2024). Jurnal Riset Dan Kajian Pendidikan Fisika, 12(1), 41–49. https://doi.org/10.12928/jrkpf.v12i1.1145

Tanjung, Y. I., Sanjaya, A. P., & Mihardi, S. (2024). Development of physics test instruments to measure problem solving skills on dynamic fluid materials. Journal of Innovative Physics Teaching, 2(2), 89–101. https://doi.org/10.24036/jipt/vol2-iss2/68

Trisnasari, E., & Oksiana, S. (2024). Identification of students’ conceptual understanding of temperature and heat material. EduFisika: Jurnal Pendidikan Fisika, 9(3), 260–267. https://doi.org/10.59052/edufisika.v9i3.37601

Wijaya, T. T., Hidayat, W., Hermita, N., Alim, J. A., & Talib, C. A. (2024). Exploring contributing factors to pisa 2022 mathematics achievement: insights from indonesian teachers. Infinity Journal, 13(1), 139–156. https://doi.org/10.22460/infinity.v13i1.p139-156

DOI: http://dx.doi.org/10.20527/bipf.v14i2.25819