Analysis of the Impact of ChatGPT Usage in Direct Current Physics Material on Enhancing Students' Higher-Order Thinking Skills (HOTS) during the Merdeka Belajar

Zakaria Al Farizi; Sahlan Sahlan; Erwin Prasetyo; Nadya Fitriani; Elyakim Mau Laleng; Hamzarudin Hikma Tiar; Zaina Anwar

doi:10.20527/bipf.v12i1.17603

Analysis of the Impact of ChatGPT Usage in Direct Current Physics Material on Enhancing Students' Higher-Order Thinking Skills (HOTS) during the Merdeka Belajar

Zakaria Al Farizi, Sahlan Sahlan, Erwin Prasetyo, Nadya Fitriani, Elyakim Mau Laleng, Hamzarudin Hikma Tiar, Zaina Anwar

Abstract

This study examines the influence of using ChatGPT to enhance students' higher-order thinking Skills (HOTS), particularly within the context of the "Merdeka Belajar" (Freedom to Learn) era in Indonesia. This inquiry arises from Indonesian students' low literacy and numeracy skills, as indicated by the PISA assessment. Employing a quasi-experimental method, the research analyzes the changes in students' HOTS before and after the ChatGPT-assisted instruction intervention within the "Merdeka Belajar" curriculum framework. The study's findings reveal a significant improvement in students' HOTS within the experimental group that utilized ChatGPT, as compared to the control group. Data analysis underscores the positive impact of integrating ChatGPT into "Merdeka Belajar"-based teaching methods, substantially enhancing students' HOTS. These results align with prior literature highlighting the role of AI technology in advancing education and fostering higher-order thinking abilities. It is imperative to consider that the effective utilization of AI technology should be complemented by appropriate teaching approaches to prepare students for future challenges. The implications of this research indicate that ChatGPT can be considered an innovative strategy to support Merdeka Belajar-based learning in Indonesia.

Keywords

AI technology; ChatGPT; Higher Order Thinking Skils (HOTS); Independent learning; Student ability

Full Text:

PDF

References

Ali, F., Yasar, B., Ali, L., & Dogan, S. (2023). Antecedents and consequences of travelers’ trust towards personalized travel recommendations offered by ChatGPT. International Journal of Hospitality Management, 114, 103588. https://doi.org/10.1016/j.ijhm.2023.103588

Alqahtani, T., Badreldin, H. A., Alrashed, M., Alshaya, A. I., Alghamdi, S. S., bin Saleh, K., Alowais, S. A., Alshaya, O. A., Rahman, I., Al

Yami, M. S., & Albekairy, A. M. (2023). The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research. Research in Social and Administrative Pharmacy, 19(8), 1236–1242. https://doi.org/10.1016/j.sapharm.2023.05.016

Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of bloom’s taxonomy of educational objectives: Complete edition. Longman.

Anisa, M. K., Permana P, N. D., & Nova, T. L. (2020). Penggunaan simulasi virtual pada pembelajaran fisika untuk meningkatkan higher order thinking skill (hots) siswa : Meta analisis. Jurnal Kumparan Fisika, 3(2), 163–170. https://doi.org/10.33369/jkf.3.2.163-170

Ausat, A. M. A., Massang, B., Efendi, M., Nofirman, N., & Riady, Y. (2023). Can chat GPT replace the role of the teacher in the classroom: A fundamental analysis. Journal on Education, 5(4), 16100–16106.

Currie, G. M. (2023). Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy? Seminars in Nuclear Medicine, 53(5), 719–730. https://doi.org/10.1053/j.semnuclmed.2023.04.008

Dahlkemper, M. N., Lahme, S. Z., & Klein, P. (2023a). How do physics students evaluate artificial intelligence responses on comprehension questions? A study on the perceived scientific accuracy and linguistic quality of chatGPT. Physical Review Physics Education Research, 19(1), 010142.

https://doi.org/10.1103/PhysRevPhysEducRes.19.010142

Dinni, H. N. (2018). HOTS (High Order Thinking Skills) dan kaitannya dengan kemampuan literasi matematika. Prisma: Prosiding Seminar Nasional Matematika, 170–176.

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). Opinion Paper: “So What if ChatGPT Wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational ai for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642

Faiz, A., & Kurniawaty, I. (2023). Tantangan penggunaan ChatGPT dalam pendidikan ditinjau dari sudut pandang moral. Edukatif: Jurnal Ilmu Pendidikan, 5(1), 456–463. https://doi.org/10.31004/edukatif.v5i1.4779

Gay, L. R. (1981). Educational research: Competencies for analysis and application. Colombus: Charles E. Merill Publishing Company.

Greitemeyer, T., & Kastenmüller, A. (2023). HEXACO, the dark triad, and chat GPT: Who is willing to commit academic cheating? Heliyon, 9(9), e19909. https://doi.org/10.1016/j.heliyon.2023.e19909

Haleem, A., Javaid, M., & Singh, R. P. (2022). An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2(4), 100089. https://doi.org/10.1016/j.tbench.2023.100089

Hallal, K., Hamdan, R., & Tlais, S. (2023). Exploring the potential of AI-Chatbots in organic chemistry: An assessment of ChatGPT and bard. Computers and Education: Artificial Intelligence, 100170. https://doi.org/10.1016/j.caeai.2023.100170

Hunter, R. B., Mehta, S. D., Limon, A., & Chang, A. C. (2023). Decoding ChatGPT: A primer on large language models for clinicians. Intelligence-Based Medicine, 100114. https://doi.org/10.1016/j.ibmed.2023.100114

Idris, F., Hassan, Z., Ya’acob, A., Gill, S. K., & Awal, N. A. M. (2012). The role of education in shaping youth’s national identity. Procedia - Social and Behavioral Sciences, 59, 443–450. https://doi.org/10.1016/j.sbspro.2012.09.299

Iyengar, Karthikeyan. P., Yousef, M. M. A., Nune, A., Sharma, G. K., & Botchu, R. (2023). Perception of chat generative pre-trained transformer (Chat-GPT) AI tool amongst msk clinicians. Journal of Clinical Orthopaedics and Trauma, 44, 102253.

https://doi.org/10.1016/j.jcot.2023.102253

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Koc, E., Hatipoglu, S., Kivrak, O., Celik, C., & Koc, K. (2023). Houston, we have a problem!: The use of ChatGPT in responding to customer complaints. Technology in Society, 74, 102333. https://doi.org/10.1016/j.techsoc.2023.102333

Kortemeyer, G. (2023). Could an artificial-intelligence agent pass an introductory physics course? Physical Review Physics Education Research, 19(1), 010132. https://doi.org/10.1103/PhysRevPhysEducRes.19.010132

Kurnia*, L. D., Haryati, S., & Linda, R. (2022). Pengembangan instrumen evaluasi higher order thinking skills menggunakan quizizz pada materi termokimia untuk meningkatkan kemampuan berpikir tingkat tinggi peserta didik. Jurnal Pendidikan Sains Indonesia, 10(1), 176–190. https://doi.org/10.24815/jpsi.v10i1.21727

Levin, G., Meyer, R., Yasmeen, A., Yang, B., Guigue, P.-A., Bar-noy, T., Tatar, A., Perelshtein Brezinov, O., & Brezinov, Y. (2023). Chat generative pre-trained transformer–written obstetrics and gynecology abstracts fool practitioners. American Journal of Obstetrics & Gynecology MFM, 5(8), 100993.

https://doi.org/10.1016/j.ajogmf.2023.100993

Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News. https://doi.org/10.1108/LHTN-01-2023-0009

Memarian, B., & Doleck, T. (2023). ChatGPT in education: Methods, potentials and limitations. Computers in Human Behavior: Artificial Humans, 100022. https://doi.org/10.1016/j.chbah.2023.100022

Murtono, & Shufa, N. K. (2022). Pengelolaan pembelajaran CTL Berbasis kearifan lokal kudus untuk meningkatkan HOTS siswa sekolah dasar. Pitutur Pesantenan, 1(1), 48–57.

Mustaghfiroh, S. (2020). Konsep “merdeka belajar” perspektif aliran progresivisme john dewey. Jurnal Studi Guru Dan Pembelajaran, 3(1), 141–147.

Pham, S. T. H., & Sampson, P. M. (2022). The Development of artificial intelligence in education: A review in context. Journal of Computer Assisted Learning, 38(5), 1408–1421. https://doi.org/10.1111/jcal.12687

Ramadani, F., & Desyandari. (2022). Konsep kurikulum merdeka belajar terhadap pandangan filsafat progresivisme. Pendas: Jurnal Ilmiah Pendidikan Dasar, 7(2), 1239–1251.

Sani, M. M. R., Meha, A. M., & Nenotek, S. A. (2020). Penerapan model siklus belajar 5e untuk meningkatkan kemampuan berpikir tingkat tinggi (HOTS) siswa di smp adhyaksa 2 kupang tahun ajaran 2018/2019. Jurnal Sains Dan Edukasi Sains, 3(1), 15–23. https://doi.org/10.24246/juses.v3i1p15-23

Saraswati, P. M. S., & Agustika, G. N. S. (2020). Kemampuan berpikir tingkat tinggi dalam menyelesaikan soal HOTS mata pelajaran matematika. Jurnal Ilmiah Sekolah Dasar, 4(2), 257. https://doi.org/10.23887/jisd.v4i2.25336

Sari, D. N. I., Budiarso, A. S., & Wahyuni, S. (2022). Pengembangan E-LKPD berbasis problem based learning (PBL) untuk meningkatkan kemampuan higher order tingking skill (HOTS) pada pembelajaran IPA. Jurnal Basicedu, 6(3), 3699–3712. https://doi.org/10.31004/basicedu.v6i3.2691

Serevina, V., Sari, Y. P., & Maynastiti, D. (2019). Developing high order thinking skills (HOTS) assessment instrument for fluid static at senior high school. Journal of Physics: Conference Series, 1185, 012034. https://doi.org/10.1088/1742-6596/1185/1/012034

Setiawan, A., & Luthfiyani, U. K. (2023). Penggunaan ChatGPT untuk pendidikan di era education 4.0: usulan inovasi meningkatkan keterampilan menulis. JURNAL PETISI (Pendidikan Teknologi Informasi), 4(1), 49–58. https://doi.org/10.36232/jurnalpetisi.v4i1.3680

Sofyan, F. A. (2019). Implementasi HOTS pada Kurikulum 2013. Jurnal Inventas, 3(1), 1–17.

Sugiyono. (2019). Metode Penelitian Kuantitatif dan Kualitatif Dan R&D. Alfabeta.

Suharno, S., Rifai, R., & Sudrajat, A. (2023). Multicultural encounters within kampus merdeka: A study on educational policy impact to bolster diversity. Jurnal Cakrawala Pendidikan, 42(2). https://doi.org/10.21831/cp.v42i2.58223

Supriyadi, E. (2022). Eksplorasi penggunaan ChatGPT dalam penulisan artikel pendidikan matematika. Papanda Journal of Mathematics and Sciences Research, 1(2), 54–68.

Susdarwono, E. T. (2021). Artificial Intelligence (AI) drone dalam pertahanan: problem dan kemajuan. Jurnal Ilmiah Intech: Information Technology Journal of UMUS, 3(1), 1–11.

Yeadon, W., Inyang, O.-O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). the death of the short-form physics essay in the coming ai revolution. Physics Education, 58(3), 035027. https://doi.org/10.1088/1361-6552/acc5cf

Yusuf, I., & Widyaningsih, S. W. (2018). Profil kemampuan mahasiswa dalam menyelesaikan soal HOTS di jurusan pendidikan fisika universitas papua. Jurnal Komunikasi Pendidikan, 2(1), 42. https://doi.org/10.32585/jkp.v2i1.63

Yuwanto, L. (2019). Metode Penelitian Ekperimen (L. Yuwanto, Ed.; 2nd ed.). Graha Ilmu.

Zajuli, I., Vivanti, D., Miarsyah, M., Ali, A., Pramita, W., & Ageng, T. (2019). HOTS-AEP: Higher order thinking skills from elementary to master students in environmental learning. European Journal of Educational Research, 8(4), 935–942. https://doi.org/10.12973/eu-jer.8.4.935

DOI: http://dx.doi.org/10.20527/bipf.v12i1.17603