The Development of HOTS Test Instrument of Thermodynamics Law for Senior High School

Yeni Rima Liana; Suharto Linuwih; Sulhadi Sulhadi

doi:10.20527/bipf.v8i2.8493

The Development of HOTS Test Instrument of Thermodynamics Law for Senior High School

Yeni Rima Liana, Suharto Linuwih, Sulhadi Sulhadi

Abstract

The main analysis in developing assessment instruments is reliability and validity. A validity test is carried out to determine the appropriateness instrument that will be developed, both construction validity and content validity. The reliability test is to determine the level of consistency of the instrument that has been developed. This research was conducted to develop the HOTS ability to test items for high school students. The grid test instruments are arranged based on competence and HOTS indicators, which are then used to arrange items. The test instrument consisted of ten question items relating to the HOTS Thermodynamic Law problem, which included: 1) analyzing the magnitude of engine efficiency, work, heat, and internal energy changes, 2) evaluating Carnot's efficiency, and 3) creating a heat engine. The assessment of the instrument HOTS test obtained Aiken's V score in the range of 0.83 to 0.94, which is in the valid criteria. The validated instrument was piloted in 141 science grade XI student in High School 2 Batang, at Batang Regency, Central Java. The level difficulty of the Polytomous data was analyzed using the QUEST program for classical analysis and PARSCALE 4 for modern analytical theory based on the Partial Credit Model (PCM). The results of data analysis of the experimental items show that of the ten-question items, all are compatible with PCM. The reliability of the test instrument is 0.84, and the item difficulty level is in the range of 0.83 to 1.22. Information functions and Standard Error Measurement (SEM) indicate that test questions developed reliably to measure HOTS students' ability with an average category in -1.9 <θ <+1.7 logit scale with SEM ± 0.5.

Keywords

HOTS test instruments; polytomous; thermodynamics law

Full Text:

PDF

References

Adams, R. J., & Khoo, S. (2016). Quest: The ınteractive test analysis system version 2.3. Victoria: The Australian Council for Educational Research.

Anderson, L., & Krathwohl, D. (2001). A taxonomy for learning, tea¬ching and assessing. New York: Longman.

Argaw, A. S., Haile, B. B., Ayalew, B. T., & Kuma, S. G. (2017). The effect of problem based learning (PBL) instruction on students’ motivation and problem solving skills of physics. Eurasia Journal of Mathematics, Science and Technology Education, 13(3), 857–871. https://doi.org/10.12973/eurasia.2017.00647a

Awopeju, & Afolabi. (2016). Comparative Analysis of Classical Test Theory and Item Response Theory Based Item Parameter Estimates of Senior School Certificate Mathematics Examination. European Scientific Journal, ESJ, 12(28), 263. https://doi.org/10.19044/esj.2016.v12n28p263

Aybek, E. C., & Demirtasli, R. N. (2017). Computerized Adaptive Test (CAT) Applications and Item Response Theory Models for Polytomous Items. International Journal of Research in Education and Science, 475–475. https://doi.org/10.21890/ijres.327907

Azwar, S. (2016). Reliabilitas dan Validitas Edisi 4. Yogyakarta: Pustaka Pelajar.

Bacci, S., Bartolucci, F., & Gnaldi, M. (2014). A class of multidimensional latent class IRT models for ordinal polytomous item responses. Communications in Statistics - Theory and Methods, 43(4), 787–800. https://doi.org/10.1080/03610926.2013.827718

Baker, & Frank. (2001). The basic of Item Response Theory. USA: USA: ERIC Clearinghouse on Assessment and Evaluation.

Baran, M. (2016). An Analysis on High School Students’ Perceptions of Physics Courses in Terms of Gender (A Sample from Turkey. Journal of Education and Training Studies, 4(3), 150–160. https://doi.org/10.11114/jets.v4i3.1243

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model. In Fundamental Measurement in the Human Sciences (3rd ed.). New York: Routledge.

DeMars, C. (2013). Item Response Theory. The Canadian Journal of Program Evaluation, 27(1), 126–128.

Docktor, J. L., Strand, N. E., Mestre, J. P., & Ross, B. H. (2015). Conceptual problem solving in high school physics. Physical Review Special Topics - Physics Education Research, 11(2), 1–13. https://doi.org/10.1103/PhysRevSTPER.11.020106

Dostál, J. (2015). Theory of Problem Solving. Procedia - Social and Behavioral Sciences, 174, 2798–2805. https://doi.org/10.1016/j.sbspro.2015.01.970

Fajrianthi, F., Hendriani, W., & Septarini, B. G. (2016). Pengembangan Tes Berpikir Kritis Dengan Pendekatan Item Response Theory. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(1), 45. https://doi.org/10.21831/pep.v20i1.6304

Grunert, M. L., Raker, J. R., Murphy, K. L., & Holme, T. A. (2013). Polytomous versus dichotomous scoring on multiple-choice examinations: Development of a rubric for rating partial credit. Journal of Chemical Education, 90(10), 1310–1315. https://doi.org/10.1021/ed400247d

Gunawan, G., Harjono, A., Herayanti, L., & Husein, S. (2019). Problem-based learning approach with supported interactive multimedia in physics course: Its effects on critical thinking disposition. Journal for the Education of Gifted Young Scientists, 7(4), 1075–1089. https://doi.org/10.17478/jegys.627162

Guney, A., & Al, S. (2012). Effective Learning Environments in Relation to Different Learning Theories. Procedia - Social and Behavioral Sciences, 46, 2334–2338. https://doi.org/10.1016/j.sbspro.2012.05.480

Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and Validating Test Items. Developing and Validating Test Items. https://doi.org/10.4324/9780203850381

Mardapi, D. (2012). Pengukuran penilaian dan evaluasi pendidikan. Nuha Medika. Yogyakarta: Nuha Medika.

Merriënboer, J. J. G. va. (2013). Perspectives on problem solving and instruction. Computers and Education, 64, 153–160. https://doi.org/10.1016/j.compedu.2012.11.025

Persichitte, K. A. (2016). Educational Technology to Improve Quality and Access on a Global Scale. In Educational Technology World Conference (ETWC 2016) Editors: Persichitte, Kay, Suparman, Atwi, Spector, Michael (Eds.).

Puspendik. (2019). Buku Penilaian Berorientasi Higher Order Thinking Skills. Jakarta: Kementerian Pendidikan dan Kebudayaan.

Reckase, M. D. (2010). Response theory. https://doi.org/10.1007/bfb0044597

Retnawati, H. (2011). Mengestimasi Kemampuan Peserta Tes Uraian Matematika Dengan Penskoran Politomus dengan Generalized Partial Credit Model. Seminar Nasional Penelitian, Pendidikan Dan Penerapan MIPA, 53–62. Retrieved from https://doi.org/eprints.uny.ac.id:7173

Royantoro, F., Mujasam, M., Yusuf, I., & Widyaningsih, S. W. (2018). Pengaruh model problem based learning terhadap higher order thinking skills peserta didik. Berkala Ilmiah Pendidikan Fisika, 6(3), 371–382.

Sambite, F. C., Mujasam, M., Widyaningsih, S. W., & Yusuf, I. (2019). Penerapan project based learning berbasis alat peraga sederhana untuk meningkatkan HOTS peserta didik. Berkala Ilmiah Pendidikan Fisika, 7(2), 141–147.

Schoenfeld, A. H. (2013). Reflections on Problem Solving Theory and Practice. The Mathematics Enthusiast, 10(1), 9–34.

Setiawati, W., Asmira, O., Ariyan, Y., Bestary, R., & Pudjiastuti, A. (2019). Buku Penilaian Berorientasi Higer Order Thinkings Skills (HOTS. In Dirjen GTK. Jakarta: Kemdikbud.

Subali, B., & Suyata, P. (2011). Panduan Analisis Data Pengukuran Pendidikan untuk Memperoleh Bukti Empirik Kesahihan Menggunakan Program Quest. Yogyakarta: Lembaga Penelitian dan Pengabdian Masyarakat UNY.

Sucipto, S. (2017). Pengembangan Ketrampilan Berpikir Tingkat Tinggi dengan Menggunakan Strategi Metakognitif Model Pembelajaran Problem Based Learning. Jurnal Pendidikan (Teori Dan Praktik, 2(1), 77. https://doi.org/10.26740/jp.v2n1.p77-85

Yadiannur, M., & Supahar. (2017). Mobile Learning Based Worked Example in Electric Circuit (WEIEC) Application to Improve the High School Students’ Electric Circuits Interpretation Ability. International Journal of Environmental and Science Education, 12(3), 539–558. https://doi.org/10.12973/ijese.2017.1246

Yuberti, Y., Latifah, S., Anugrah, A., Saregar, A., Misbah, M., & Jermsittiparsert, K. (2019). Approaching problem-solving skills of momentum and impulse phenomena using context and problem-based learning. European Journal of Educational Research. https://doi.org/10.12973/eu-jer.8.4.1217

DOI: http://dx.doi.org/10.20527/bipf.v8i2.8493