Development and Validation of a CBT-Based Arabic Question Bank for Secondary Education
DOI:
https://doi.org/10.31958/lughawiyah.v7i2.16058Keywords:
Arabic, Computer Bassed Test, Question Bank DevelopmentAbstract
The educational process often overlooks the evaluation aspect of learning, as educators frequently develop assessment instruments without adhering to established guidelines, despite evaluation being a critical component in determining the effectiveness and development of education. This study employed a mixed-methods Research and Development (R&D) approach to develop an Arabic question bank for Grade X students at State Islamic High School (MAN) 1 Pohuwato. Quantitatively, logical validity results showed that expert validators awarded a total score of 74 with an average of 3.89, while practitioner validators provided a total score of 71 with an average of 3.74, both categorized as very valid, resulting in a combined average validity score of 3.815. Qualitatively, the high validity values were supported by expert and practitioner evaluations indicating that the test items were clearly formulated, aligned with curriculum competencies, and appropriately represented the intended cognitive levels. Following the validation process, the revised items were tested in two classes, X-A and X-D, involving 36 students. This development research produced a set of 40 Arabic multiple-choice questions ready for use in the Mid-Term Examination (UTS) and Final Examination (UAS). The implications of this study show that CBT-based Arabic question banks can improve the objectivity, efficiency, and quality of Arabic learning evaluation in madrasas.
References
Alkhatib, O. J. (2022). An Effective Assessment Method of Higher-Order Thinking Skills (Problem-Solving, Critical Thinking, Creative Thinking, and Decision-Making) in Engineering and Humanities. 2022 Advances in Science and Engineering Technology International Conferences, ASET 2022. https://doi.org/10.1109/ASET53988.2022.9734856
Ardellea, F., & Hamdu, G. (2022). Pentingnya Kemampuan Guru Sekolah Dasar dalam Mengembangkan Soal Tes Literasi dan Numerasi Berbasis Education for Sustainable Development (ESD). Edu Cendikia: Jurnal Ilmiah Kependidikan, 2(02), 220–227. https://doi.org/10.47709/educendikia.v2i02.1587
Bahrun, Maulana, R., Muslem, A., & Yulianti. (2023). Designing Assessment, Learning Strategies, and Obstacles in Facing Computer-Based Madrasah Exam on the English Subject. Studies in English Language and Education, 10(2), 884 – 906. https://doi.org/10.24815/siele.v10i2.31954
Beerepoot, M. T. P. (2023). Formative and Summative Automated Assessment with Multiple-Choice Question Banks. Journal of Chemical Education, 100(8), 2947–2955. https://doi.org/10.1021/acs.jchemed.3c00120
Cáceres, M., Nussbaum, M., & Ortiz, J. (2020). Integrating critical thinking into the classroom: A teacher’s perspective. Thinking Skills and Creativity, 37, 100674. https://doi.org/https://doi.org/10.1016/j.tsc.2020.100674
Chituc, C.-M., Herrmann, M., Schiffner, D., & Rittberger, M. (2019). Towards the Design and Deployment of an Item Bank: An Analysis of the Requirements Elicited. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11841 LNCS, 155–162. https://doi.org/10.1007/978-3-030-35758-0_15
Desiriah, E., & Setyarsih, W. (2021). Tinjauan Literatur Pengembangan Instrumen Penilaian Kemampuan Berpikir Tingkat Tinggi (Hots) Fisika Di Sma. ORBITA: Jurnal Kajian, Inovasi Dan Aplikasi Pendidikan Fisika, 7(1), 79. https://doi.org/10.31764/orbita.v7i1.4436
Destiana, D., Suchyadi, Y., & Anjaswuri, F. (2020). Pengembangan instrumen penilaian untuk meningkatkan kualitas pembelajaran produktif di sekolah dasar. Jurnal Pendidikan Dan Pengajaran Guru Sekolah Dasar (JPPGuseda), 3(2), 119–123. https://doi.org/https://doi.org/10.55215/jppguseda.v3i2.2720
Eleragi, A. M. S., Miskeen, E., Hussein, K., Rezigalla, A. A., Adam, M. I. E., Al-Faifi, J. A., Alhalafi, A., Al Ameer, A. Y., & Mohammed, O. A. (2025). Evaluating the multiple-choice questions quality at the College of Medicine, University of Bisha, Saudi Arabia: a three-year experience. BMC Medical Education, 25(1). https://doi.org/10.1186/s12909-025-06700-2
Gebril, A. (2017). Arabic language teachers’ conceptions of assessment and the hidden tension between accountability and improvement in Egyptian schools. In The Routledge Handbook of Arabic Linguistics (pp. 560–574). https://doi.org/10.4324/9781315147062
Hakami, Y. A. A., Hussin, A. R. B. C., & Dahlan, H. M. (2015). Technology acceptance for CBT in secondary schools of Saudi Arabia. Proceedings - International Conference on Intelligent Systems, Modelling and Simulation, ISMS, 2015-September, 804–807. https://doi.org/10.1109/ISMS.2014.148
Hannon, P., Lappe, K., Griffin, C., Roussel, D., Colbert-getz, J., Roussel, D., & Colbert-getz, J. (2019). An objective structured clinical examination : From examination room to Zoom breakout room. Medical Education Adaptations, 54(9), 14241. https://doi.org/10.1111/medu.14241
Hastini, L. Y., Fahmi, R., & Lukito, H. (2020). Apakah Pembelajaran Menggunakan Teknologi dapat Meningkatkan Literasi Manusia pada Generasi Z di Indonesia? Jurnal Manajemen Informatika (JAMIKA), 10(1), 12–28. https://doi.org/10.34010/jamika.v10i1.2678
Hatamnejad, M. R., Shirvani, M., Pourhoseingholi, M. A., Balaii, H., Shahrokh, S., Aghdaei, H. A., Koolaeian, A., & Cheraghpour, M. (2023). Translation and cross-cultural adaptation of the Persian version of inflammatory bowel disease-fatigue (IBD-F) self-assessment questionnaire. PLoS ONE, 18(7 July). https://doi.org/10.1371/journal.pone.0288592
Khoerunnisa, P., & Aqwal, S. M. (2020). Analisis Model-model Pembelajaran. Fondatia, 4(1), 1–27. https://doi.org/10.36088/fondatia.v4i1.441
Krzic, M., & Brown, S. (2022). Question banks for effective online assessments in introductory science courses. Natural Sciences Education, 51(2). https://doi.org/10.1002/nse2.20091
Luecht, R. M. (2015). Computer-Based Test Delivery Models, Data, and Operational Implementation Issues. In Technology and Testing: Improving Educational and Psychological Measurement (pp. 179–205). https://doi.org/10.4324/9781315871493-10
Makruf, I., & Barokah, A. (2023). Improving the Quality of ICT-Based Arabic Learning Assessment With Online Applications. Journal of Higher Education Theory and Practice, 23(11), 32 – 40. https://doi.org/10.33423/jhetp.v23i11.6216
Malik, R. H., & Malik, A. S. (2020). Developing A Bank of Faculty-Authored, Valid and Reliable Objective Questions for Institutional Use: Sharing the Experience. Malaysian Journal of Medicine and Health Sciences, 16, 28–35. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85092237321&partnerID=40&md5=b5fb7514878af72131c6e6e43c2332f5
Moh Firdaus, Hula, I. R. N., & Bahri, R. B. H. (2023). Arabic Language Teacher Website Media Development in the Teaching and Learning Process of Qiraah Material. 2(3), 353–366. https://doi.org/https://doi.org/10.58194/eloquence.v2i3.1424
Mohamad Aso Samsudin, & Ukhtul Iffah. (2019). Penilaian Autentik Pada Matapelajaran Pendidikan Agama Islam. Edupedia, 4(1), 77–85. https://doi.org/10.35316/edupedia.v4i1.528
Mujiatun, S., Jasin, H., Fahmi, M., & Jufrizen, J. (2022). Model Financial Technology (Fintech) Syariah di Sumatera Utara. Owner, 6(3), 1709–1718. https://doi.org/10.33395/owner.v6i3.893
Muttaqin, B. I. A. (2019). Telaah Kajian dan Literature Review Design of Experiment (DoE). Journal of Advances in Information and Industrial Technology, 1(1), 33–40. https://doi.org/10.52435/jaiit.v1i1.10
Natadireja, U., & Nurachadijat, K. (2023). Evaluasi Pendidikan Menuju Insan Kamil dalam Perspektif Filsafat Ilmu. Al-Idaroh: Jurnal Studi Manajemen Pendidikan Islam, 7(2), 253–267. https://doi.org/10.54437/alidaroh.v7i2.929
Niimi, N., & Matsuura, N. (2022). Assessing Japanese junior high school students’ English achievement through computer-based testing in the classroom: a case of integrated reading-into-writing continuous task. Language Testing in Asia, 12(1). https://doi.org/10.1186/s40468-022-00189-y
Noval, Y., & Adhani, A. (2021). Analisis Soal Penilaian Akhir Semester Pada Mata Pelajaran Biologi Kelas X Berdasarkan Taksonomi Anderson Di Sma Negeri 1 Tarakan. Borneo Journal Of Biology Education, 3(1), 18–28. https://doi.org/https://doi.org/10.35334/bjbe.v3i1.1887
Nugroho, H. Y. S. H., Basuki, T. M., Pramono, I. B., Savitri, E., Purwanto, Indrawati, D. R., Wahyuningrum, N., Adi, R. N., Indrajaya, Y., Supangat, A. B., Putra, P. B., Auliyani, D., Priyanto, E., Yuwati, T. W., Pratiwi, Narendra, B. H., Sukmana, A., Handayani, W., Setiawan, O., & Nandini, R. (2022). Forty Years of Soil and Water Conservation Policy, Implementation, Research and Development in Indonesia: A Review. Sustainability (Switzerland), 14(5). https://doi.org/10.3390/su14052972
Pellas, N. (2025). Exploring learning outcomes and psycho-emotional experiences of undergraduate students in digital literacy training and support using Web-based assessment platforms. Journal of Research on Technology in Education, 57(4), 820–841. https://doi.org/10.1080/15391523.2024.2323451
Punoševac, M., & Nikolić, A. (2024). AI in Action: Transforming Assessment Practices – A Case Study of YouTestMe. CEUR Workshop Proceedings, 3938, 139–151. https://www.scopus.com/inward/record.uri?eid=2-s2.0-105000232374&partnerID=40&md5=bbd5029f455a0cfb64c165b05e1bc18c
Rayón, A., Guenaga, M., & Núñez, A. (2014). Integrating and visualizing learner and social data to elicit higher-order indicators in SCALA dashboard. ACM International Conference Proceeding Series, 16-19-September-2014. https://doi.org/10.1145/2637748.2638435
Reza Amirian, S. M., Abbasi, F. M., & Zolfagharkhani, M. (2023). EFL Learners’ Perspective towards Online Assessments during COVID-19 Outbreak. International Journal of Language Testing, 13(2), 188–205. https://doi.org/10.22034/IJLT.2023.382556.1226
Rosdiana, R., Budiana, S., Mahajani, T., & Talitha, S. (2022). Penerapan HOTS pada Soal-soal Buku Teks Pelajaran Bahasa Indonesia Tingkat SMA. Aksara: Jurnal Ilmu Pendidikan Nonformal, 8(2), 1065. https://doi.org/10.37905/aksara.8.2.1065-1074.2022
Rustanto, P. C. R., & Prayitno, B. A. (2023). Developing Complex Multiple-Choice Test to Empower Students Higher Order Thinking Skill about Excression System. AIP Conference Proceedings, 2540. https://doi.org/10.1063/5.0107968
Strother, J. B., Fazal, Z., Johnson, A., & Millsap, M. (2008). Effects of test modality - Computer-based versus Paper-and-Pencil - On nonnatives’ English results. Proceedings of the 7th IASTED International Conference on Web-Based Education, WBE 2008, 133–138. https://www.scopus.com/inward/record.uri?eid=2-s2.0-62949209289&partnerID=40&md5=9bb8a0a1e843a3402ce160f2fbcd2912
Syarifah, L. L., Yenni, & Dewi, W. K. (2020). Analisis Soal-Soal Pada Buku Ajar Matematika Siswa. Jurnal Cendekia: Jurnal Pendidikan Matematika, 04(02), 1259–1272. https://doi.org/https://doi.org/10.31004/cendekia.v4i2.335
Syarifah, N. Y., & Asda, P. (2021). Computer Based Test Sebagai Alternatif Metode Penilaian Evaluasi Pembelajaran Manajemen Keperawatan. Jurnal Kesehatan Masyarakat, 14(2), 478–486. https://doi.org/https://doi.org/10.47317/jkm.v14i2.367
Utami, T. P., Sjaifuddin, S., & Berlian, L. (2021). Pengembangan Soal Uraian Berbasis Indikator Kemampuan Berpikir Tingkat Tinggi pada Konsep Sistem Pencernaan pada Manusia untuk Siswa Kelas VIII SMP/Mts. PENDIPA Journal of Science Education, 6(1), 128–134. https://doi.org/10.33369/pendipa.6.1.128-134
Utomo, I. F. (2021). Pengembangan Media Pembelajaran Video Tutorial Menjahit Lengan Tulip Siswa Kelas X Tata Busana Di SMK Muhammadiyah 1 Tempel. Jurnal Fesyen: Pendidikan Dan Teknologi, 10(1). https://doi.org/https://doi.org/10.21831/teknik%20busana.v10i1.17232
Wallace, M. P., & Ke, H. (2023). Examining the Content Alignment Between Language Curriculum and A Language Test in China. Teflin Journal, 34(1), 116–135. https://doi.org/10.15639/teflinjournal.v34i1/116-135
Yu, W., & Iwashita, N. (2021). Comparison of test performance on paper-based testing (PBT) and computer-based testing (CBT) by English-majored undergraduate students in China. Language Testing in Asia, 11(1). https://doi.org/10.1186/s40468-021-00147-0
Zhang, X. (2021). Preparing first-year college students’ academic transition: What is the value of complementary web-based learning? Computers & Education, 172, 104265. https://doi.org/https://doi.org/10.1016/j.compedu.2021.104265
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Nurul Aini Pakaya, Ibnu Rawandhy N. Hula, Nikma S Abdjul, Adtman A. Hasan, Yousif Abdelmannan Mohamed Godat Arrashedy
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
