Design of Vocational High School Students’ Skills Test Instrument Based on Construction Services Needs

Rolly Oroh, Nova A. R. A. Mamarimbing, Morris S. S. S. Tumanduk, Sonny D. J. Mailangkay, Ferdinan S. R. P. Terok, Muhammad M. Attaufiq, Jenly D. I. Manongko

Abstract


Student skills test instruments, based on industry needs, help measure and ensure that students have the practical skills needed in the workplace. This study evaluated the performance criteria of students in concrete structure work, which was used as the basis for designing a work skills test instrument for vocational high school students based on construction service needs. This study involved vocational high school teachers, construction service providers, and vocational education experts as participants. The research data from the responses of the research participants were analyzed in terms of practicality and effectiveness index values, while the essence of the instrument was analyzed with the Lawshe index value. The instruments designed in this study were adjusted to types of concrete structure work. The results showed a practicality index of 4.83 and an effectiveness index of 4.93, while the Lawshe index value was 0.64. This study has found the vocational high school student skills test instrument very practical, effective, and essential as a tool for measuring the level of vocational student skills. This student skills test instrument can be integrated with a competency certification program for students before entering the workforce. The results of this study serve to recommend that related educational institutions implement the student work skills testing process.

https://doi.org/10.26803/ijlter.24.4.32


Keywords


Vocational education; vocational high school; skills test instruments; construction service needs

Full Text:

PDF

References


Aliu, J., & Aigbavboa, C. (2020). Structural determinants of graduate employability: impact of university and industry collaborations. Journal of Engineering Design and Technology, 19(5), 1080–1100. https://doi.org/10.1108/jedt-05-2020-0189

Ambiyar, Panyahuti, Devega, A., & Islami, S. (2024). Web and android-based test application development and its implementation on final semester examination. JOIV: International Journal on Informatics Visualization, 8(2), 768–776. https://doi.org/10.62527/joiv.8.2.2120

Ayre, C., & Scally, A. J. (2014). Critical Values for Lawshe’s Content Validity Ratio: Revisiting the Original Methods of Calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86. https://doi.org/10.1177/0748175613513808

Blömeke, S. (2017). Assuring quality in competence assessments: the value added of applying different assessment approaches to professional education (Chapter 29). In M. Mulder (Ed.), Competence-based Vocational and Professional Education, Bridging the Worlds of Work and Education. Springer. https://www.researchgate.net/publication/308412901_Competence-based_Vocational_and_Professional_Education_Bridging_the_Worlds_of_Work_and_Education

BPS RI. (2024). Keadaan ketenagakerjaan Indonesia Febuari 2024 (Indonesian Labor Situation, February 2024). Berita Resmi Statistik, No. 36/05/Th. XXVII, 6 Mei 2024. Central Bureau of Statistics of the Republic of Indonesia (BPS RI), Jakarta, Indonesia. https://www.bps.go.id/id/publication/2024/06/07/bd40ab2fa4fac6c726ab4ad4/keadaan-pekerja-di-indonesia-februari-2024.html

Churiyah, M., Putri, O. M., Arief, M., Dharma, B. A., Sukmawati, E., & Zainuddin, Z. (2023). Project based learning interactive e-book: a solution to self-regulated learning and student learning outcomes. Proceedings of the BISTIC Business Innovation Sustainability and Technology International Conference (BISTIC 2023), Advances in Economics, Business and Management Research, 132–142. Atlantis Press. https://doi.org/10.2991/978-94-6463-302-3_17

Deutscher, V., & Winther, E. (2019). A Conceptual Framework for Authentic Competence Assessment in VET: A Logic Design Model. In S. McGrath, M. Mulder, J. Papier, & R. Suart (Ed.), Handbook of Vocational Education and Training Developments in the Changing World of Work. Springer Nature Switzerland. https://doi.org/10.1007/978-3-319-94532-3

De Vos, M. E., Baartman, L. K. J., Van der Vleuten, C. P. M., & De Bruijn, E. (2022). Unravelling workplace educators’ judgment processes when assessing students’ performance at the workplace. Journal of Vocational Education & Training. https://doi.org/10.1080/13636820.2022.2042722

Elfaki, A. O., & Alatawi. (2015). Representing the knowledge of public construction project cost estimator by using rule-based method. Journal of Building Construction and Planning Research, 3(4), 189–195. http://dx.doi.org/10.4236/jbcpr.2015.34019

Ewing, B. (2017). An exploration of assessment approaches in a vocational and education training courses in Australia. Empirical Research in Vocational Education and Training, 9(14). https://doi.org/10.1186/s40461-017-0058-z

Ferm, L. (2020). Vocational students’ ways of handling the academic/vocational divide. International Journal for Research in Vocational Education and Training, 8(1), 1–20. https://doi.org/10.13152/IJRVET.8.1.1

Gulikers, J. T. M., Runhaar, P., & Mulder, M. (2017). An assessment innovation as flywheel for changing teaching and learning. Journal of Vocational Education & Training, 70(2), 212–231. https://doi.org/10.1080/13636820.2017.1394353

Hampf, F., & Woessmann, L. (2017). Vocational vs. general education and employment over the life cycle: new evidence from piaac. Cesifo Economic Studies. https://doi.org/10.1093/cesifo/ifx012

Hansen, S., Rostiyanti, S. F., Setiawan, A. F., & Koesalamwardi, A. B. (2022). Developing a work-integrated learning model adjusting to construction 4.0 concepts. International Journal of Work-Integrated Learning, 23(1), 65–80. https://www.ijwil.org/files/IJWIL_23_1_65_80.pdf

Hass, C. (2019). A Practical Guide to Usability Testing. In M. Edmunds, C. Hass, & E. Holve (Eds.), Consumer Informatics and Digital Health. Springer. https://doi.org/10.1007/978-3-319-96906-0_6

Hiim, H. (2017). Ensuring curriculum relevance in vocational education and training: Epistemological perspectives in a curriculum research project. International Journal for Research in Vocational Education and Training, 4(1), 1–19. https://doi.org/10.13152/IJRVET.4.1.1

Hiim, H. (2023). How can collaboration between schools and workplaces contribute to relevant vocational education? Results of an action research project in the school-based part of Norwegian vocational education and training. Vocations and Learning, 16, 1– 21. https://doi.org/10.1007/s12186-022-09300-z

Kementerian PUPR. (2021). Era baru konstruksi berkarya menuju Indonesia maju [The new era of construction is working towards a developed Indonesia]. Minister for public works and human settlements (Kementerian PUPR). Jakarta, Indonesia.

Kepmenaker RI. (2021). Standar Kompetensi Kerja Nasional Indonesia (SKKNI) pada jabatan kerja pelaksana lapangan pekerjaan gedung [Indonesian National Work Competency Standards (SKKNI) for work positions implementing building work]. Regulation of the Minister of Manpower of the Republic of Indonesia (Kepmenaker RI). Jakarta, Indonesia.

Khampirat, B., Pop, C., & Bandaranaike, S. (2019). The effectiveness of work-integrated learning in developing student work skills: A case study of Thailand. International Journal of Work-Integrated Learning, 20(2), 127–146. https://www.ijwil.org/files/IJWIL_20_2_127_146.pdf

Mehta, M., Armpriest, D., & Scarborough, W. (2013). Building construction, principles, materials, and systems. Pearson Education.

Mentele, S. R., & Heinzer, S. F. (2021). Practical validation framework for competence measurement in VET: a validation study of an instrument for measuring basic commercial knowledge and skills in Switzerland. Empirical Research in Vocational Education and Training, 13(18). https://doi.org/10.1186/s40461-021-00122-2

Misbah, Z., Gulikers, J., Dharma, S., & Mulder, M. (2020). Evaluating competence-based vocational education in Indonesia. Journal of Vocational Education & Training, 72(4), 488–515. https://doi.org/10.1080/13636820.2019.1635634

Mulder, M. (2017). Competence-based vocational and professional education, bridging the worlds of work and education. Springer International Publishing Switzerland. http://dx.doi.org/10.1007/978-3-319-41713-4

Munawar, W., Ridwan, A., & Sriyono, S. (2019). Development of performance assessment standard career with dichotomy scoring as competence test at vocational school. Proceedings of the 5th UPI International Conference on Technical and Vocational Education and Training (ICTVET 2018). https://doi.org/10.2991/ictvet-18.2019.113

Nkwanyane, T. P. (2023). Understanding the demand for industrial skills through the national certificate (vocational) building and civil engineering programme. International Journal of Learning, Teaching and Educational Research, 22(5), 674–687. https://doi.org/10.26803/ijlter.22.5.35

Ohle-Peters, A., McElvany, N., & Ullrich, M. (2023). Students’ Text-Picture-Integration: The Role of Teacher Competence and Instructional Quality. International Journal of Educational Psychology, 12(3), 251–268. https://doi.org/10.17583/ijep.11558

Oroh, R. R., Haris, A. S., Sugandi, R. M., & Isnandar. (2018). What are the dominant factors of students’ productive skills in construction services? IOP Conf. Ser.: Mater. Sci. Eng, 306. https://iopscience.iop.org/article/10.1088/1757-899X/306/1/012111

Oroh, R. R., Runtuwene, J. P. A., Tumanduk, M. S. S., & Palilingan, V. R. (2020). Relevance of student productive skills competencies based on construction services needs. International Journal of Innovation and Learning, 28(1), 4–11. https://doi.org/10.1504/IJIL.2020.108461

Oroh, R. R., Attaufiq, M. M., Daud, M., & Roring, R. F. (2023). Analysis of Vocational Student Performance Criteria on Work Skills Based on Industry Needs: An Analysis for Students’ Skill Test Instruments. International Journal of Learning, Teaching and Educational Research, 22(10), 174–189. https://doi.org/10.26803/ijlter.22.10.10

Oroh, R. R., Kembuan, D. R., Daud, M., Attaufiq, M. M., & Roring, R. F. (2024). What is the Form of Collaboration between SMK and Construction Services in Providing Guarantees for the Relevance of Student Work Skills? 5th Vocational Education International Conference (VEIC-5 2023) (pp. 1508-1513). Atlantis Press. https://doi.org/10.2991/978-2-38476-198-2_214

Perpres RI. (2012). Kerangka Kualifikasi Nasional Indonesia [Indonesian National Qualifications Framework]. Regulation of the President of the Republic of Indonesia [Perpres RI]. Jakarta, Indonesia. https://pasca.unpad.ac.id/wp-content/uploads/simple-file-list/Appendix-5-Biotechnology-KKNI-Indonesian-National-Qualification-Framework-.pdf

Ponto, H. (2019). Development of an Assessment of Science Process Skills of Basic Electrical Engineering in the Vocational High School. International Journal of Recent Technology and Engineering, 8(2S), July 2019. https://www.ijrte.org/portfolio-item/b10020782s19/

Preston, J. (2017). Competence based education and training (CBET) and the end of human learning. Springer Nature. http://dx.doi.org/10.1007/978-3-319-55110-4

Ralf, A. L. F. van Griethuijsen, Eva, M. Kunst, Marianne van Woerkom, Renate, Wesselink, & Rob F. Poell. (2020). Does implementation of competence-based education mediate the impact of team learning on student satisfaction? Journal of Vocational Education & Training, 72(4), 516–535. https://doi.org/10.1080/13636820.2019.1644364

Rosyid, A. (2020). Evaluation of Competency Test and Work Competency Certification Implementations at Professional Certification Institute – First Party (LSP P1). Journal of Vocational and Career Education, 5(2), 81–88. https://doi.org/10.15294/jvce.v5i2.26946

Setiyawami, Sugiyo, Sugiyono, & Rahardjo, T. J. (2020). The Role of Vocational Education on the Advancement of Human Development in Indonesia. International Conference on Science and Education and Technology (ISET 2019), Advances in Social Science, Education and Humanities Research, 443. Atlantis Press. https://doi.org/10.2991/assehr.k.200620.079

Subiyantoro, H. (2023). The role of vocational education as the key to economic development in Indonesia. Proceedings of the 3rd Multidisciplinary International Conference, MIC 2023, 28 October 2023, Jakarta, Indonesia. https://doi.org/10.4108/eai.28-10-2023.2341745

Tentama, F., Merdiaty, N., & Subardjo, S. (2019). Self-efficacy and work readiness among vocational high school students. Journal of Education and Learning (Edulearn), 13(2), 277–281. https://doi.org/10.11591/edulearn.v13i2.12677

Tsai, H., Lee, A., Lee, H., Chen, C., & Liu, K. (2020). An application of the fuzzy Delphi method and fuzzy AHP on the discussion of training indicators for the regional competition, Taiwan national skills competition, in the trade of joinery. Sustainability, 12(10), 4290. https://doi.org/10.3390/su12104290

Wahyudi, W., Suharno, S., & Pambudi, N. (2023). Evaluate the vocational school graduate’s work-readiness in Indonesia from the perspectives of soft skills, roles of teacher, and roles of employer. Journal of Curriculum and Teaching, 12(1), 110. https://doi.org/10.5430/jct.v12n1p110

Wesselink, R., Biemans, H., Gulikers, J., & Mulder, M. (2017). Models and principles for designing competence-based curricula, teaching, learning and assessment. In M. Mulder (Ed.), Competence-based vocational and professional education, bridging the worlds of work and education. Springer. http://dx.doi.org/10.1007/978-3-319-41713-4.


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493