Computer-Based Test (CBT) Assisted Assessment with Rasch Model to Improve Vocational High School Teachers' Skills

Novika Lestari, Erlin Eveline, M Akip, Julia Inayatul Marifah, Noperiska Fitri Ramda

Abstract


The aim of the community service program conducted is to enhance the skills of teachers and students at Bina Kusuma Private Vocational High School in Nanga Pinoh by using computer-based tests and improving teachers' skills in analysing the quality of assessment instruments using the Rasch model theory with the assistance of WinStep. The proposed solution to address these challenges involves conducting workshops and assisting in preparing test instruments. This includes guidance on using computer-based tests for both teachers and students, as well as workshops and assistance in applying the Rasch model to determine the validity of instruments. This community service used Participatory Action Research (PAR) method to find problems experienced by partners. The partners' issues consist of instruments from authentic assessments used at Bina Kusuma Private Vocational High School in Nanga Pinoh, which were made independently by the respective subject teachers and were directly used as benchmarks for student achievement, and the assessment instruments still did not utilise the available resources (computers and smartphones). Efforts made to address the partners' issues included developing authentic assessment instruments that were appropriate and valid. Based on the evaluation results of the activity implementation using the Kick Patrick Level 1 method, the average evaluation score for the presenters was 82.125, and the average evaluation score for the method, relevance and usefulness, facilities, and consumption was 88.75. The constraints encountered in this activity were that the community service program implementers needed to consider timing and conduct more in-depth evaluations. Recommendations for implementing community service program activities included developing a more structured community service program and integrating it with routine school activities.


Keywords


assessment; computer-based test; evaluation; measurement; rasch model

Full Text:

PDF

References


Agustiningsih, N., & Sholehah, N. (2023). Optimalisasi pengelolaan 3b (bak, bank sampah, basecamp kerajinan) menuju go green madrasah di lombok tengah ntb. Bubungan Tinggi: Jurnal Pengabdian Masyarakat, 5(1), 559–569.

Carpenter, R., & Alloway, T. (2018). Computer versus paper-based testing: are they equivalent when it comes to working memory? Journal of Psychoeducational Assessment, 37(3), 382–394.

Chappuis, J., Stiggins, R., Chappuis, S., & Arter, J. (2012). Classroom assessment for student learning: Doing it right-using it well. New York: Pearson.

Debelak, R., Strobl, C., & Zeigenfuse, M. (2022). An introduction to the rasch model with examples in r. CRC Press

Handoko, H., Tolla, B., & Suprihati, Y. (2019). The evaluation of computer-based national examination system in Indonesia. Indonesian Journal of Educational Review, 6(1), 35–43.

Hasyim, F., Prastowo, T., & Jatmiko, B. (2020). The use of android-based phet simulation as an effort to improve students’ critical thinking skills during the covid-19 pandemic. International Journal of Interactive Mobile Technologies.

Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247.

Irfan, M., Patta, R., Rahman, A., Bundu, P., Amran, M., & Author, C. (2022). PKM pelatihan penyusunan asesmen pembelajaran berorientasi higher order thinking skills (hots). CARADDE: Jurnal Pengabdian Kepada Masyarakat, 5(2), 301–310.

Iskandar, A. (2019). Evaluasi diklat asn model kirkpatrick (studi kasus pelatihan effective negotiation skill balai diklat keuangan makassar). Jurnal Pendidikan, 20(1), 18–39.

Karim, K., Hidayanto, T., Kamaliyah, K., & Arrasyid, M. F. (2021). Workshop pembuatan soal matematika berbantukan google form serta teknik analisis validitas-reliabilitasnya bagi guru peserta mgmp matematika mts dan ma kota banjarmasin. Bubungan Tinggi: Jurnal Pengabdian Masyarakat, 3(3), 235–241.

Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3(2), 103–122.

Marzano, R., Frontier, T., & Livingston, D. (2011). Effective supervision: Supporting the art and science of teaching. ASCD.

Marzuki, A. G., Farkhan, M., Surahman, D., Daryanto, D., & Febrianto, S.

(2020). Computer based testing in senior high school on national examination. Journal.Ilininstitute.Com, 2(2), 204–210.

Pramanik, P. D., Maudiarti, S., & Enggriani, M. (2022). Penguatan keterampilan interpersonal bagi guru-guru smp terbuka mandiri teuku umar baitul maal tangerang selatan. Sarwahita, 19(03), 364-375.

Pramita, M., Sukmawati, R. A., Sukmawati, R. A., Adini, M. H., Adini, M. H., Ngestu, I. F., Ngestu, I. F., Noorsafitri, T. M., & Noorsafitri, T. M. (2021). Media evaluasi pembelajaran berbasis kahoot! untuk guru sd di kabupaten tanah bumbu. Bubungan Tinggi: Jurnal Pengabdian

Masyarakat, 3(4), 349–356.

Rizal, M., & Mustapita, A. F. (2023). Literasi ekonomi guna meningkatkan kualitas tenaga kerja sektor umkm di kabupaten malang. Bubungan Tinggi: Jurnal Pengabdian Masyarakat, 5(3), 1195–1204.

Rusdiana, H., Sumardi, K., Mechanical, E. A.-J. O., & 2014, undefined. (2014). Evaluasi hasil belajar menggunakan penilaian autentik pada mata pelajaran kelistrikan sistem refrigerasi. Academia.Edu, 1(2).

Saa’dah, M. A., & Fitriah, L. (2023). Seminar kesulitan belajar dan anti bullying di sman 5 banjarbaru. Bubungan Tinggi: Jurnal Pengabdian Masyarakat, 5(4), 1574–1581.

Shiau-Wei Chan, A., Looi, C.-K., Sumintono Source, B., Chan, S.-W., &

Sumintono, B. (2020). Assessing computational thinking abilities among Singapore secondary students: a Rasch model measurement analysis. Springer, 8(2), 213–236.

Suparman, A. R., Rohaeti, E., & Wening, S. (2023). Effect of computer based test on motivation: A meta-analysis. European Journal of Educational Research, 12(4), 1583.

Tananda, O., Nasir, M., Milana, M., & Muslim, M. (2023). Perbandingan antara sistem computer based test dan paper based test pada hasil pembelajaran mata pelajaran pmkr di smkn 1 sumatera barat. JTPVI: Jurnal Teknologi Dan Pendidikan Vokasi Indonesia, 1(1), 67–74.

Tarigan, E. F., Nilmarito, S., Islamiyah, K., Darmana, A., & Suyanti, R. D. (2022). Analisis instrumen tes menggunakan rasch model dan software spss 22.0. Jurnal Inovasi Pendidikan Kimia, 16(2), 92-96.

Witmer, S. E., & Bouck, E. C. (2023). Predictors of accessibility tool use on a low-stakes computer-based math test. Assessment for Effective Intervention, 49(1), 7-17.




DOI: https://doi.org/10.20527/btjpm.v6i3.10789

Refbacks

  • There are currently no refbacks.


Indexed by:

Bubungan Tinggi: Jurnal Pengabdian Masyarakat is licensed under
Creative Commons Attribution-Share Alike 4.0

From March 27, 2020 to June 3, 2020
View My Stats

From Juni 4, 2020 to the present (updated stats)
View My Stats