Evaluation of Higher Order Thinking Skill (HOTS) Dimensions in Arabic Items Using Multidimensional Item Response Theory (MIRT)
DOI:
https://doi.org/10.31958/lughawiyah.v7i1.13800Keywords:
Arabic Question, Higher Order Thinking Skill, Response TheoryAbstract
This research is motivated by the problem in the preparation of Arabic midterm questions that have not followed the correct procedure, so that the quality in measuring Higher Order Thinking Skills (HOTS) has not been guaranteed. This study aims to analyze the HOTS dimensions in Arabic questions, assess the validity, reliability, difficulty level, and differentiating power of the questions, and provide recommendations for developing HOTS-based questions. The method used is descriptive quantitative with the subject 172 students of class XI SMA Nusantara Plus. Data were obtained from 35 multiple-choice questions, which were analyzed using Multidimensional Item Response Theory (MIRT) with R software, and validity and reliability were tested with SPSS. The results showed that 70% of the questions were effective in measuring HOTS, with the dominance of questions measuring the analysis dimension. However, some questions still show bias in the evaluation dimension that needs to be corrected. The validity of the questions was proven with a loading factor > 0.3, and high reliability with CronbachÔÇÖs Alpha 0.85. In addition, 50% of the questions have a medium level of difficulty and good differentiating power. In conclusion, the Arabic test questions are quite effective in measuring HOTS, but need improvement in a more even distribution of HOTS dimensions. Further research is recommended to develop more varied and quality HOTS-based questions.
References
Adam, J. M., & Scotuzzi, C. A. S. (2013). Violence and Conflict in Schools: Analysis of Proposals Based on Restorative Justice in Brazil. Procedia - Social and Behavioral Sciences, 106, 3312–3319. https://doi.org/10.1016/j.sbspro.2013.12.383
Amdani, Y. (2016). Konsep Restorative Justice Dalam Penyelesaian Perkara. Al-Adalah, XIII.
Aria Zurnetti. (2017). Kedudukan Hukum Pidana Adat Dalam Penegakan Hukum dan Relevansinya Dengan Pembaruan Hukum Pidana Nasional. Universitas Andalas.
Efendi, R. (2019). Kriminalisasi Nikah Sirri Menurut Rancangan Undang-Undang Hukum Materiil Peradilan Agama Bidang Perkawinan. Pagaruyuang Law Journal, 2(2). 221–238.
Efendi, Roni. (2019). Konstitusionalitas Masa Tunggu Eksekusi bagi Terpidana Mati dalam Sistem Pemidanaan. Jurnal Konstitusi, 16(2), 296–332.
https://doi.org/10.31078/jk1625
Fathurokhman, F. (2013). The Necessity of Restorative Justice on Juvenile Delinquency in Indonesia, Lessons Learned from the Raju and AAL Cases. Procedia Environmental Sciences, 17, 967–975.
https://doi.org/10.1016/j.proenv.2013.02.115
Fitri, B. S., et al. (2021). Asas Ultimum Remedium/ The Last Resort Principle Terhadap Pelaku Usaha dalam Hukum Perlindungan Konsumen. Doktrina: Journal of Law, 4(April), 68–83.
Hakim, L. (2020). Asas-Asas Hukum Pidana. Penerbit Deepublish.
Handoko, D. (2015). Kriminalisasi dan Dekriminalisasi. Hawa dan Ahwa.
Handoko, D. (2016). Dekriminalisasi Terhadap Delik-Delik Dalam KUHP. Penerbit Hawa dan Ahwa.
Hendarto, Y., & Ma’ruf, U. (2018). Diversion in Children Criminal Justice System Through Restorative Justice. Jurnal Daulat Hukum, 1(2), 331.
https://doi.org/10.30659/jdh.v1i2.3269
Hidayat, B. R., Aprilianda, N., & Endrawati, L. (2022). Legal Implications of Stopping the Investigation Because the Forced Defense (Noodweer) and Emergency Defense Exceed the Limits (Noodweer Excesses). International Journal of Multicultural and Multireligious Understanding, 9(2), 244.
https://doi.org/10.18415/ijmmu.v9i2.3405
Kelsen, H. (2011). General Theory of Law and State (Rasisul Mu). Nusa Media.
Peraturan Kepolisian Negara Republik Indonesia Nomor 8 Tahun 2021 Tentang Penanganan Tindak Pidana Berdasarkan Keadilan Restoratif.
Lo, L. Z. K. (2021). Non-Timber Forest Products as Livelihood Restoration in Forest Conservation: A Restorative Justice Approach. Trees, Forests and People, 6, 100130. https://doi.org/10.1016/j.tfp.2021.100130
Long, R., Cleveland Manchanda, E. C., Dekker, A. M., Kraynov, L., Willson, S., Flores, P., Samuels, E. A., & Rhodes, K. (2022). Community Engagement Via Restorative Justice to Build Equity-Oriented Crisis Standards of Care. Journal of the National Medical Association, 114(4), 377–389. https://doi.org/10.1016/j.jnma.2022.02.010
Marder, I. D. (2022). Mapping Restorative Justice and Restorative Practices in Criminal Justice in the Republic of Ireland. International Journal of Law, Crime and Justice, 70(March), 100544.
https://doi.org/10.1016/j.ijlcj.2022.100544
Maulidar, M. (2021). Korelasi Filosifis Antara Restorative Justice dan Diyat Dalam Sistem Hukum Pidana Islam. Jurnal Ilmiah Prodi Muamalah, 13, 143–155.
Nasution, B. J. (2014). Kajian Filosofis Tentang Konsep Keadilan daari Pemikiran Klasik Sampai Pemikiran Modern. Kajian Filosofis Tentang Konsep Keadilan, 3(2).
Norfan Wahyu Putera. (2020). Peran Kerapatan Adat Nagari Dalam Pemerintahan Otonom Di Nagari Panyalakan Kecamatan Kubung Kabupaten Solok Provinsi Sumatera Barat. Universitas Islam Negeri Sultan Syarif Kasim.
O.C. Kaligis. (2006). Perlindungan Hukum Atas Hak Asasi Tersangka, Terdakwa dan Terpidana. Alumni.
Ramadhani, G. S. dkk. (2012). Sistem Pidana dan Tindakan “Double Track System” dalam Hukum Pidana di Indonesia. Diponegoro Law Review, 1(4).
Riedl, K., Jensen, K., Call, J., & Tomasello, M. (2015). Restorative Justice in Children. Current Biology, 25(13), 1731–1735. https://doi.org/10.1016/j.cub.2015.05.014
Roni Efendi. (2016). Kedudukan Masa Tunggu Eksekusi Bagi Terpidana Mati Dalam Sistem Pemidanaan. Andalas.
Roni Efendi. (2021). Kebijakan Hukum Pidana Dalam Pemberantasan Tradisi Omerta Tindak Pidana Korupsi di Indonesia (Hebby Rahmatul Utamy (Ed.)). Deepublish Publisher.
Santoso, M. A. (2014). Hukum, Moral dan Keadilan Sebuah Kajian Filsafat Hukum. Universitas Islam Indonesia, 2, 20–48.
Siregar, G. T. P., Silaban, R., & Gustiranda, P. (2020). Kebangkitan Hak-Hak Sipil Penghayat Kepercayaan Parmalim Pasca Pasal 61 Ayat (1) Putusan Mahkamah Konstitusi Nomor 97/Puu-Xiv/2016 Di Kota Medan. JURNAL RECTUM: Tinjauan Yuridis Penanganan Tindak Pidana, 2(2), 75. https://doi.org/10.46930/jurnalrectum.v2i2.642
Wafiyah, R. (2012). Konsep Keadilan. Skripsi. Universitas Islam Negeri Maulana Malik Ibrahim, 20–62.
Wibawa, I. (2017). Pidana Kerja Sosial Dan Restitusi Sebagai Alternatif Pidana Penjara Dalam Pembaharuan Hukum Pidana Indonesia. Jurnal Media Hukum, 24(2), 105–114.
https://doi.org/10.18196/jmh.2017.0086.105-114
Widayati, L. S. (2015). Ultimum Remedium dalam Bidang Lingkungan Hidup. Jurnal Hukum Ius Quia Iustum, 22(1), 2.
Zailul Daulay, et al. (2011). Sinergitas Ninik Mamak dan Aparat Kepolisian Dalam Menyelesaikan Konflik Hukum Pidana di Sumatera Barat.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Elyatul Mu'awanah
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
