Confirmatory factor analysis of problem-based learning instrument for Office Management and Business Service program
DOI:
https://doi.org/10.21831/pep.v29i1.84368Keywords:
non-test instrument, confirmatory factor analysis, office management and business service program, problem-based learningAbstract
This study examines the development and validation of a non-test instrument for assessing the Problem-Based Learning (PBL) model in vocational high schools, specifically within the Office Management and Business Services (OMBS) program. The instrument covers seven constructs: problem identification, fact identification, hypothesis formulation, self-directed learning, collaboration and cooperation, solution determination, and evaluation of the problem-solving process. This study uses a quantitative method with a Confirmatory Factor Analysis (CFA) approach to test the validity and reliability of the instrument. Using probability sampling with simple random sampling, 372 respondents (30 teachers and 342 students) from vocational schools in Surabaya participated. Data analysis was conducted using SPSS 16 for reliability testing and LISREL 8.8 for CFA. Results showed high internal consistency (Cronbach's Alpha = 0.949) and satisfactory anti-image coefficients (>0.5), indicating that the data met the requirements for factor analysis. The results of the model fit test also showed that the developed CFA with modification indices model met the criteria for a good fit with a Chi-square value of 170.51 with a degree of freedom (df) of 110, producing a p-value = 0.00019, an RMSEA value of 0.039 <0.08. The validity and reliability of the constructs in each instrument indicator also prove that this model meets a good fit with the resulting value above 0.5. Thus, this non-test instrument is worthy of being used as an assessment standard for evaluating problem-based learning in vocational high schools in the OMBS program to improve the quality of student learning outcomes.References
Aquino, T. De, & Yambi, C. (2020). Assessment and evaluation in education. July.
Arta, G. Y. (2024). Asesmen dalam pendidikan: Konsep, pendekatan, prinsip, jenis, dan fungsi. Jurnal Pendidikan, Bahasa dan Budaya, 3(3), 170–190. https://doi.org/10.55606/jpbb.v3i3.3925
Asrulla, A., Risnita, R., Jailani, M. S., & Jeka, F. (2023). Populasi dan sampling (kuantitatif), serta pemilihan informan kunci (kualitatif) dalam pendekatan praktis. Jurnal Pendidikan Tambusai, 7(3), 26320–26332. https://doi.org/10.31004/jptam.v7i3.10836
Bariyyah, K., Pratama, A. M., Tsaqofah, A., Pratiwi, N. P., Siwi, R. A. C., Ahfadzi, Y. F., Budiyono, A. L., & Maizura, N. (2024). Confirmatory factor analysis (CFA) untuk validasi instrumen sexual bullying questionnaire (SEBUQU). Jurnal EDUCATIO: Jurnal Pendidikan Indonesia, 10(2), 258–265. https://doi.org/10.29210/1202424887
Brown, T. A. (2016). Confirmatory Factor Analysis for Applied Research (second, Vol. 4, Issue 1).
Byrne, B. M. (2016). Structural Equation Modeling with Amos.
Croasmun, J. T., & Ostrom, L. (2011). Using Likert-type scales in the social sciences. Journal of Adult Education, 40(1), 19–22. https://files.eric.ed.gov/fulltext/EJ961998.pdf
de Jonge, J. (2006). Multivariate data analysis (Sixth Edition). Gedrag & Organisatie, 19(3), 123–145. https://doi.org/10.5117/2006.019.003.007
Dewi, I. K., Arsurahmah, A., Syaharani, D., Putri, S., & Marhadi, H. (2024). Tinjauan terhadap efektivitas instrumen penilaian non tes di sekolah dasar: Studi kasus Kelas VI SDN 130 Pekanbaru. Jurnal Ilmiah Kajian Multidisipliner, 8(5), 538–545.
Edwards, R. (2002). Lifelong learning, lifelong learning, lifelong learning: A recurrent education? In Lifelong learning: Education across the lifespan (pp. 1–13). Routledge. https://doi.org/10.4324/9780203183328-1
Fatihatussa'adah, I., Yamtinah, S., Ariani, S. R. D., Wiyarsi, A., Widarti, H. R., Shidiq, A. S., & Abrori, F. M. (2024). Fostering collaboration and enhancing student learning achievement through the integration of ethnoscience in the Common Knowledge Construction Model with podcast media. Indonesian Journal on Learning and Advanced Education, 6(3), 295–314. https://doi.org/10.23917/ijolae.v6i3.23222
Ghazali, N., & Nordin, M. S. (2019). Measuring meaningful learning experience: Confirmatory factor analysis. International Journal of Innovation, Creativity and Change, 9(12), 283–296.
Herwin, & Nurhayati, R. (2021). Measuring students' curiosity character using confirmatory factor analysis. European Journal of Educational Research, 10(2), 773–783. https://doi.org/10.12973/eu-jer.10.2.773
Imaduddin, M. F., Maulani, H., & Taufik, I. H. (2022). Test the validity and reliability of Arabic learning questions. Arabi : Journal of Arabic Studies, 7(2), 198–207. https://doi.org/10.24865/ajas.v7i2.523
Jí¶reskog, K. G., & Sí¶rbom, D. (1993). LISREL 8: Structural Equation Modeling with the SIMPLIS Command Language. Scientific Software International.
Kemendikbud. (2016). Permendikbud_Nomor 23_Tahun 2016. BPK RI. https://peraturan.bpk.go.id/Details/224434/permendikbud-no-23-tahun-2016
Khairi, M. I., Susanti, D., & Sukono, S. (2021). Study on structural equation modeling for analyzing data. International Journal of Ethno-Sciences and Education Research, 1(3), 52–60. https://doi.org/10.46336/ijeer.v1i3.295
Khasanah, M. M., Ramli, M., & Dwiastuti, S. (2020). Developing a dynamic assessment instrument to assess reasoning skills about bacteria. Jurnal Penelitian dan Evaluasi Pendidikan, 24(1). 1-12. https://doi.org/10.21831/pep.v24i1.28815
Marlett, D. (2024). Effective Performance-Based Assessments Empower Students to Demonstrate Knowledge and Skills. Leraning-Focused. https://learningfocused.com/effective-performance-based-assessments-empower-students-to-demonstrate-knowledge-and-skills/
Nurbaiti, B. (2021). Tutorial Pengolahan Data dengan Lisrel (Issue April).
Nurrahman, A., Cahyani, M. D., Nurfatmawati, L., Wibowo, H., & Analysis, C. F. (2023). Developing E-Learning Evaluation Instruments : A Study in Vocational. 3(3), 163–174.
Nurrahman, A., Sukirno, S., Pratiwi, D. S., Iskandar, J., Rahim, A., & Rahmaini, I. S. (2022). Developing student social attitude self-assessment instruments: A study in vocational high school. REID (Research and Evaluation in Education), 8(1), 1–12. https://doi.org/10.21831/reid.v8i1.45100
Pada, A. U. T., Mustakim, S. S., & Subali, B. (2018). Construct validity of creative thinking skills instrument for biology student teachers in the subject of human physiology. Jurnal Penelitian dan Evaluasi Pendidikan, 22(2), 119–129. https://doi.org/10.21831/pep.v22i2.22369
Pierce, L. V., & O'Malley, J. M. (1992). Performance and portfolio assessment for language minority students. Program Information Guide Series, 9. National Clearinghouse for Bilingual Education. https://eric.ed.gov/?id=ED346747
Pranata, A. H., Sumarno, & Dwijayanti, I. (2021). Analisis kesulitan penyusunan instrumen penilaian bagi guru sekolah dasar di Gugus Dewi Sartika Kecamatan Reban. Widya Sari, 23(5), 105–110.
Putri, R. D. P., & Febrilia, Y. (2024). Confirmatory factor analysis (CFA) on the quality of critical thinking instruments, motivation, and learning achievement of learners. Pendagogia: Jurnal Pendidikan Dasar, 4(2), 73–84. https://jurnal.educ3.org/index.php/pendagogia/article/view/183.
Rusijono, R., Jaedun, A., Kartowagiran, B., Ahman, A., Laliyo, L. A. R., & Mam, S. (2020). Developing the teacher's social competency assessment instrument in the fourth industrial revolution era. Jurnal Penelitian dan Evaluasi Pendidikan, 24(2), 125–135. https://doi.org/10.21831/pep.v24i2.29482.
Sainuddin, S., Subali, B., Jailani, & Elvira, M. (2022). The development and validation of prospective mathematics teachers' holistic assessment tools. Ingénierie des Systèmes d'Information, 27(2), 171–184. https://doi.org/10.18280/isi.270201
Salsabila, Y. R., & Muqowim, M. (2024). Korelasi antara teori belajar konstruktivisme Lev Vygotsky dengan model pembelajaran problem based learning (PBL). LEARNING: Jurnal Inovasi Penelitian Pendidikan dan Pembelajaran, 4(3), 813–827. https://doi.org/10.51878/learning.v4i3.3185
Sarmento, R. P., & Costa, V. (2019). Confirmatory factor analysis – A case study. arXiv. https://doi.org/10.48550/arXiv.1905.05598
Savery, J. R. (2006). Overview of problem-based learning: Definitions and distinctions. Interdisciplinary Journal of Problem-Based Learning, 1(1), 9–20. https://doi.org/10.7771/1541-5015.1002
Selviana, M., & Puspasari, D. (2023). Analyzing the application of the problem-based learning model in office management and business services subjects. Journal of Office Administration: Education and Practice, 3(2), 84–94. https://doi.org/10.26740/joaep.v3n2.p84-94
Septiana, N., & Hermanto, F. Y. (2024). Construct validity of non-test instrument for problem-based learning method. Journal of Office Administration: Education and Practice, 4(1), 1–9. https://doi.org/10.26740/joaep.v4n1.p1-9
Sternberg, R. J., Chowkase, A., Parra-Martinez, F. A., & Landy, J. (2022). Criterion-referenced assessment of intelligence as adaptation to the environment: Is it possible, plausible, or practical? Journal of Intelligence, 10(3), 57. https://doi.org/10.3390/jintelligence10030057
Sugiyono. (2019). Metode Penelitian Kuantitatif Kualitatif dan R&D (Sutopo (ed.)). Alfabeta.
Sureshchandar, G. S. (2023). Quality 4.0 – a measurement model using the confirmatory factor analysis (CFA) approach. International Journal of Quality and Reliability Management, 40(1), 280–303. https://doi.org/10.1108/IJQRM-06-2021-0172
Tohari, B., & Rahman, A. (2024). Konstruktivisme Lev Semonovich Vygotsky dan Jerome Bruner: Model pembelajaran aktif dalam pengembangan kemampuan kognitif anak. Nusantara: Jurnal Pendidikan Indonesia, 4(1), 209–228. https://doi.org/10.14421/njpi.2024.v4i1-13.
Umar, J., & Nisa, Y. F. (2020). Uji validitas konstruk dengan CFA dan pelaporannya. Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I), 9(2), 1–11. https://doi.org/10.15408/jp3i.v9i2.16964
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Jurnal Penelitian dan Evaluasi Pendidikan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The authors submitting a manuscript to this journal agree that, if accepted for publication, copyright publishing of the submission shall be assigned to Jurnal Penelitian dan Evaluasi Pendidikan. However, even though the journal asks for a copyright transfer, the authors retain (or are granted back) significant scholarly rights.
The copyright transfer agreement form can be downloaded here: [JPEP Copyright Transfer Agreement Form]
The copyright form should be signed originally and sent to the Editorial Office through email to jurnalhepi@uny.ac.id
Jurnal Penelitian dan Evaluasi Pendidikan by http://journal.uny.ac.id/index.php/jpep is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
