Development of a validation system (SVeR) based on the open journal system for testing the validity of learning tools
Downloads
The prevalence of unvalidated learning tools highlights a critical issue stemming from inefficient manual validation processes. This research addresses this by developing a valid, practical, and effective validation system (SVeR) for learning tools, integrated with an open journal system. Employing the Waterfall development model, the study involved 2 expert validators and 16 lecturers to assess the system's practicality and effectiveness. Data analysis utilized Aiken's V for validity, percentage techniques for practicality, and the kappa moment test for effectiveness. Results indicate SVeR possesses very high validity, with a content validity coefficient of 0.804. Practicality was also very high at 94.31% (convenient category), and effectiveness reached a kappa moment of 0.939, categorized as very high. These findings confirm that SVeR offers excellent validity, practicality, and effectiveness for assessing learning device suitability. Future research should test SVeR across institutions, compare systems, evaluate integration, and expand its applications.
Ahmed, A. O. A (2023). Using efficient planning for achieving course learning outcomes in EFL Classes at Taif University. European Scientific Journal, ESJ, 19(29), 21-36. https://doi.org/10.19044/esj.2023.v19n29p21
Al-ayed, S. I., Al-tit, A. A., & Alashjaee, A. (2019). The effect of digital transformation on organizational performance by a mediating role of digital innovation. Migration Letters, 20(7), 380–394. https://doi.org/10.59670/ml.v20i7.4313
Allen, M. J. (2004). Assessing academic programs in higher education. Anker Company.
Anggrella, D. P., Izzati, L. R., & Sudrajat, A. K. (2023). Improving the quality of learning through lesson plan preparation workshops for an independent learning model. Indonesia Journal of Community Service and Empowerment, 4(1), 162–171. https://doi.org/10.22219/jcse.v4i1.24581
Apriany, R., & Setiawan, S. (2022). Perancangan sistem informasi pembayaran sekolah berbasis web pada SIT Al Haraki. Jurnal Keilmuan Teknologi Informasi dan Ilmu Manajemen, 2(2), 32–39. http://jurnalilmiah.id/index.php/Justifi/article/view/43
Arikunto, S. (2012). Fundamentals of educational evaluation. Rineka Cipta.
Ayriza, Y. (2013). Penyusunan dan validasi modul “social life skill” bagi pendidik anak-anak prasekolah. Jurnal Penelitian dan Evaluasi Pendidikan, 12(2), 213–231. https://doi.org/10.21831/pep.v12i2.1428
Aziira, A. H., Kamil, H., & Kartika, A. D. (2023). Pembangunan sistem informasi pengelolaan rencana pembelajaran semester (RPS). Jurnal Nasional Teknologi dan Sistem Informasi, 9(2), 103–112. https://doi.org/10.25077/teknosi.v9i2.2023.103-112
Bamary, K., Behboudi, M. R., & Abbasnejad, T. (2022). An ICT Performance evaluation model based on meta-synthesis approach. Journal of Information Systems and Telecommunication, 10(3), 229–240. https://doi.org/10.7208/chicago/9780226655895.003.0001
Bezrukova, N., Huk, L., Chmil, H., Verbivska, L., Komchatnykh, O., & Kozlovskyi, Y. (2022). Digitalization as a trend of modern development of the world economy. WSEAS Transactions on Environment and Development, 18(13), 120–129. https://doi.org/10.37394/232015.2022.18.13
Biggs, J., & Tang, C. (2011). Teaching for quality learning at university: What the student does (4th ed.). McGraw-Hill Education.
Budiastuti, D., & Bandur, A. (2020). Validitas dan reliabilitas penelitian. Mitra Wacana Media
Darmini, A. A. S. R., & Putra, I. N. Wi. A. P. (2009). Pemanfaatan teknologi informasi dan pengaruhnya pada kinerja individual pada Bank Perkreditan Rakyat di Kabupaten Tabanan. Jurnal Ilmiah Akuntansi dan Bisnis, 4(1), 1–15. file:///D:/PEMANFAATAN_TEKNOLOGI_INFORMASI_DAN_PENGARUHNYA_PA.pdf
Dayi, N., & Mtshali, T. I. (2026). Evaluating the GET electrical technology syllabus for transition into FET specialisations in Gauteng Technical Schools. Jurnal Inovasi Teknologi Pendidikan, 13(1), 70–81. https://doi.org/10.21831/jitp.v13i1.90695
Diputra, K. S., Tristiantari, N. K. D., & Jayanta, I. N. L. (2020). Gerakan literasi digital bagi guru-guru sekolah dasar. JCES (Journal of Character Education Society), 3(1), 118–128. https://doi.org/10.31764/jces.v3i1.1483
Fajrin, N., Kamelia, L., & Juhana, T. (2016). Instalasi dan implementasi open journal system di local area network laboratorium telematika STEI-ITB. SENTER, (pp. 26-27). UIN Sunan Gunung Djati Bandung. https://senter.ee.uinsgd.ac.id/repositori/index.php/prosiding/article/view/senter2016p3
Farhang, A. P. Q., Hashemi, A. P. S. S. A., & Ghorianfar, A. P. S. M. (2023). Lesson plan and its importance in teaching process. International Journal of Current Science Research and Review, 06(08), 5901–5913. https://doi.org/10.47191/ijcsrr/v6-i8-57
Fink, L. D. (2013). Creating significant learning experiences: An integrated approach to designing college courses (2nd ed.). Jossey-Bass.
Firdaus, T. A., Putra, R. H., Arifandi, F., Anam, M. K., & Lathifah, L. (2023). Implementasi sistem rencana pembelajaran semester berbasis web untuk mempermudah proses pembelajaran. Jurnal Teknoinfo, 17(1), 156-169. https://doi.org/10.33365/jti.v17i1.2348
Foumani, M. F., & Goudariz, S. M. (2021). The Development of a Hybrid Error Feedback Model for Sales Forecasting. Journal of Information Systems and Telecommunication, 9(34), 131–140. https://doi.org/10.29252/jist.9.34.131
Gorenšek, T., & Kohont, A. (2019). Conceptualization of digitalization: Opportunities and challenges for organizations in the Euro-mediterranean area. International Journal of Euro-Mediterranean Studies, 12(2), 93–115. https://www.dlib.si/details/URN:NBN:SI:DOC-XBGA1JHF?&language=eng
Handayani, I., Febriyanto, E., & Shofwatullah, M. (2019). Peningkatan sistem pengelolaan e-journal berbasis open journal system (OJS) 2.3.4 ke versi 3.1.0.1. Jurnal Ilmiah SISFOTENIKA, 9(1), 1–13. https://doi.org/10.30700/jst.v9i1.422
Hasmawaty, H., Syam, H., & Saman, A. (2020). Validity, practicality, and effectiveness: The last step in development of entrepreneurship education based role-playing for kindergarten. Universal Journal of Educational Research, 8(12B), 8092–8101. https://doi.org/10.13189/ujer.2020.082611
Helmina, H., Santoso, H., Nurdin, N., & Ikhsan, M. (2023). Perancangan sistem evaluasi Dosen oleh Mahasiswa (Edom) Universitas Muhammadiyah Jambi berbasis website. Jurnal Informatika, Sistem Informasi dan Kehutanan (FORSINTA), 2(1), 14–20. https://doi.org/10.53978/jfsa.v2i1.263
Kadir, J. S., Zaim, M., & Refnaldi, R. (2019). Developing instruments for evaluating validity, practicality, and effectiveness of the authentic assessment for speaking skill at junior high school. 6th International Conference on English Language and Teaching (ICOELT 2018) Developing, (276), 98–105. https://doi.org/10.2991/icoelt-18.2019.14
Kalavaini, K. et al. (2021). Predicting student performance for early intervention using classification algorithms in machine learning. Journal of Information Systems and Telecommunication, 9(36), 226–235. https://doi.org/10.52547/JIST.9.36.226
Kouser, S., & Majid, I. (2021). Technological tools for enhancing teaching and learning process. Towards Excellence, 13(1), 366–373. https://doi.org/10.37867/te130133
Kraus, S., Jones, P., Kailer, N., Weinmann, A., Chaparro-Banegas, N., & Roig-Tierno, N. (2021). Digital transformation: An overview of the current state of the art of research. SAGE Open, 11(3). https://doi.org/10.1177/21582440211047576
Kravchenko, O., Leshchenko, M., Marushchak, D., & Vdovychenko, Y. (2019). Digitalization as a global trend and growth factor of the modern economy. CEUR Workshop Proceedings, 2422, 434–443. https://doi.org/10.1051/shsconf/20196507004
Kurniawan, M. S. (2022). The role of information technology in improving the effectiveness of education management. Journal on Education, 04(04), 1658–1665. https://repository.poltekapp.ac.id/id/eprint/3860/
Lialestani, M. M., Khamseh, A., & Radfar, R. (2021). Digital transformation model, based on grounded theory. Journal of Information Systems and Telecommunication, 9(36), 275–284. https://doi.org/10.52547/JIST.9.36.275
Maulana, I., Ganefri, G., & Yulastri, A. (2024). Practicality of using e-learning learning media in entrepreneurship courses. Journal International of Lingua and Technology, 3(1), 163–174. https://doi.org/10.55849/jiltech.v3i1.583
Mentsiev, A. U., Engel, M. V, Tsamaev, A. M., Abubakarov, M. V, & Yushaeva, R. S.-E. (2020). The concept of digitalization and its impact on the modern economy. Proceedings of the International Scientific Conference “Far East Con” (ISCFEC 2020), 128(March), 10–15. https://doi.org/10.2991/aebmr.k.200312.422
Mohajan, H. K. (2017). Two criteria for good measurements in research: Validity and reliability. Annals of Spiru Haret University. Economic Series, 17(4), 59–82. https://doi.org/10.26458/1746
Muhsinin, U., & Fatmawati, K. (2020). Validitas dan praktikalitas rencana pembelajaran semester (RPS) terintegrasi research based learning. Jurnal Ilmiah Universitas Batanghari Jambi, 20(1), 201-206. https://doi.org/10.33087/jiubj.v20i1.791
Munthe, B. O., Amalia, F., & Cholissodin, I. (2019). Pengembangan sistem informasi penilaian dan evaluasi kinerja karyawan dengan metode weighted product berbasis web. Pengembangan Teknologi Informasi dan Ilmu Komputer, 3(9), 9095–9104. https://j-ptiik.ub.ac.id/plugins/generic/pdfJsViewer/pdf.js/web/viewer.html?file=https%3A%2F%2Fj-
ptiik.ub.ac.id%2Findex.php%2Fj-ptiik%2Farticle%2Fdownload%2F6348%2F3055%2F44333
Muslihudin, M., Imamudin, M. A., Mohidin, S.Kom, M.T, I., Musa, S.T., M.Kom, S. B., Badu, F., irfan & soyusiawaty dewi, Zain, S. A., Sari, E. M., & Arif, M. (2019). Pengembangan sistem informasi penerimaan siswa baru berbasis web di SMA 1 Annuqayah Sumenep. Jurnal Ilmiah Pendidikan dan Informatikan, 4(2), 53-62. https://doi.org/10.21107/edutic.v4i2.3914
Nurafni, Tjandi, Y., Mappeasse, M. Y., Suhardi, I., & Riska, M. (2022). Pengembangan sistem informasi pelaporan kinerja guru pada keterlaksanaan pembelajaran berbasis dashboard di SMKN 3 Takalar. Information Technology Education Journal, 1(2), 7–17. https://doi.org/10.59562/intec.v1i2.228
Nurjanah, S., Istiyono, E., Widihastuti, W., Iqbal, M., & Kamal, S. (2023). The application of Aiken’s V method for evaluating the content validity of instruments that measure the implementation of formative assessments. Journal of Research and Educational Research Evaluation, 12(2), 2023–2125. https://doi.org/10.15294/jere.v12i2.76451
Nurlaelah, N., Syahid, A., Fuady, M. I. N., & Lestari, M. F. (2021). Improving learning activities and outcomes of students by application of observation-based learning. Universal Journal of Educational Research, 9(3), 479–486. https://doi.org/10.13189/ujer.2021.090307
Ordu, U. B. A (2021). The role of teaching and learning aids/methods in a changing world. New Challenges to Education: Lessons from Around the World, 19, 210–216. https://eric.ed.gov/?id=ED613989
Ovcharuk, O., Ivaniuk, I., Soroko, N., Gritsenchuk, O., & Kravchyna, O. (2020). The use of digital learning tools in the teachers’ professional activities to ensure sustainable development and democratization of education in European countries. E3S Web of Conferences, 166, 1-6. https://doi.org/10.1051/e3sconf/202016610019
Parwata, K. Y. L., & Sudiatmika, A. A. I. A. R. (2020). The effectiveness of learning tools in science learning. Journal of Physics: Conference Series, 1503(1), 1-8. https://doi.org/10.1088/1742-6596/1503/1/012049
Prastika, Y. (2022). Pengembangan pembelajaran e-learning berbasis syam-ok pada mata kuliah manajemen pembelajaran di Progam Studi Teknologi Pendidikan. [Thesis, Universitas Negeri Makassar. http://eprints.unm.ac.id/24241/%0Ahttp://eprints.unm.ac.id/24241/1/SKRIPSI JILID.pdf
Raković, L., Sakal, M., & Matkovic, P. (2022). Digital workplace: Advantages and challenges Digital workplace – advantages and challenges Дигитално радно место – предности и изазови. Анали Економског Факултетa у Суботици – The Annals of the Faculty of Economics in Subotica, 58(47), 65–78.
https://doi.org/10.5937/AnEkSub2247065R
Rakovská, J. (2020). The impact of digitization and automation of production on the role of the workforce in companies in Slovakia. SHS Web of Conferences, 83, 1-7. https://doi.org/10.1051/shsconf/20208301055
Renaldo, N., Suhardjo, Suharti, Suyono & Cecilia (2022). Benefits and challenges of technology and information
systems on performance. Journal of Applied Businerss and Technology, 3(3), 302–305. https://doi.org/10.35145/jabt.v3i3.114
Romero, M. V. D., & Quilumbaquín, E. C. A. (2022). Herramientas educativas como apoyo en la enseñanza. Mendive. Revista de Educación, 20(4), 1099–1108. https://dialnet.unirioja.es/servlet/articulo?codigo=8730168
Salamun, S., & Arisandi, D. (2020). Sistem monitoring kinerja Dosen pada institusi perguruan tinggi swasta (Studi kasus: Universitas Abdurrab). Digital Zone: Jurnal Teknologi Informasi dan Komunikasi, 11(2), 198–208. https://doi.org/10.31849/digitalzone.v11i2.4304
Saputri, Y. G., & Guspatni, G. (2021). Validitas dan praktikalitas media pembelajaran PowerPoint-iSpring terintegrasi pertanyaan prompting pada materi larutan elektrolit dan nonelektrolit kelas X SMA/MA. Entalpi Pendidikan Kimia, 2(1), 57–65. https://doi.org/10.24036/epk.v2i1.128
Setiawan, R., Kurniadi, D., & Supriatna, Y. (2023). Perancangan sistem informasi monitoring dan pelaporan kinerja aparatur sipil negara berbasis web dan Android. Jurnal Algoritma, 20(1), 156–167. https://doi.org/10.33364/algoritma/v.20-1.1281
Setiyowati, R., Fatihah, H., Handoko, A. I., Chairunnisa, D., & Parianda, P. J. (2023). The urgency of using teaching materials based on e-book problem-based learning. Proceedings of the Fifth Sriwijaya University Learning and Education International Conference (SULE-IC 2022), 1, 59–64. https://doi.org/10.2991/978-2-38476-010-7_8
Sholichah, A. S., Alam, M., & Sastradiharja, E. E. J. (2023). Digitalization of education and its impact on urban society: A study on junior high school teachers. Al-Ishlah: Jurnal Pendidikan, 15(3), 2895–2905. https://doi.org/10.35445/alishlah.v15i3.2103
Stranack, K. (2006). The role of open source software in scholarly publishing. First Monday, 11(10). https://doi.org/10.5210/fm.v11i10.1402
Susilo, A., Fauziyyah, A., Hartari, A., Nurdiana, D., & Endah, E. Y. (2026). Enhancing student academic services through AI-driven virtual assistants using the RAG method at Universitas Terbuka. Jurnal Inovasi Teknologi Pendidikan, 13(1), 57–69. https://doi.org/10.21831/jitp.v13i1.83632
Todorov, I., & Todorova, N. (2021). Managing sustainability of national security: Implications for Ukraine. E3S Web of Conferences, 307, 1–15. https://doi.org/10.1051/e3sconf/202130709001
Tomoliyus, T., & Sunardianta, R. (2020). Validitas Aiken’s instrumen tes untuk mengukur reaktif agility olahraga khusus tenis meja. Jurnal Keolahragaan, 8(2), 148–157. https://doi.org/10.21831/jk.v8i2.32492
Vaske, J. J., Whittaker, D., Shelby, B., & Manfredo, M. J. (2002). Indicators and standards: Developing definitions of quality. In Wildlife Viewing in North America: A Management Planning Handbook, (pp. 143–171). Corvallis. https://www.researchgate.net/publication/250613443_Indicators_and_Standards_Developing_Definitions_of_Quality
Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the hots test of physics based on modern test theory: Question modeling through e-learning of Moodle LMS. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a
Willinsky, J. (2005). Open Journal Systems: An example of open source software for journal management and publishing. Library Hi Tech, 23(4), 504–519. https://doi.org/10.1108/07378830510636300
Yang, Z., Laffréchine, K., Bony-Dandrieux, A., Dolidon, H., & Barroca, B. (2021). Practical indicators for road infrastructure resilience to flood risks in France, case study of Nantes Ring Road network. FLOODrisk 2020 – 4th European Conference on Flood Risk Management, 207–213. https://doi.org/10.3311/floodrisk2020.11.21
Zaborovskaia, O., Nadezhina, O., & Avduevskaya, E. (2020). The impact of digitalization on the formation of human capital at the regional level. Journal of Open Innovation: Technology, Market, and Complexity, 6(4), 1–24. https://doi.org/10.3390/joitmc6040184
Copyright (c) 2026 Safrizal Safrizal, Syamsul Bahri, Desri Jumiarti, Musawer Hakimi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The journal allows the author(s) to hold the copyright without restrictions. Finally, the journal allows the author(s) to retain publishing rights without restrictions
 | Jurnal Inovasi Teknologi Pendidikan by http://journal.uny.ac.id/index.php/jitp is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. |
