Measurement of Non-academic Attributes in the Situational Judgment Test as Part of School Teacher Selection: Systematic Literature Review

Azad Iqram Nadmilail, Mohd Effendi @ Ewan Mohd Matore, Siti Mistima Maat

Abstract


The Situational Judgment Test (SJT) has become an increasingly well-known measurement method that is frequently used in various fields, especially for personnel selection, promotion, and professional development. The SJT also has a greater potential in relation to the selection of teachers in the education sector. Teacher selection aspects such as non-academic attributes, specifically the interpersonal and intrapersonal, are the focus of this study. This study uses a Systematic Literature Review (SLR) consisting of a review protocol to determine the topic that has been researched and the method used for making revisions. The SLR approach has four phases: searching, screening, analysing, and the results with numerous criteria established. The review consists of seven studies on teacher selection using the SJT instrument over the past ten years during the period January 2012 to December 2021. Eight interpersonal attributes were obtained based on six previous studies, namely organisation, planning, empathy, communication, teaching, relationships with colleagues, counselling, and contingency. Meanwhile seven intrapersonal attributes were obtained, namely conscientiousness, mindset, emotion regulation, adaptability, enthusiasm and motivation, resilience, and professional ethics. The attributes found can be utilised as they are fundamental for teacher selection criteria. The previous studies employed the same attributes. However, the attributes should only be employed according to the suitability of the selection context being performed.

https://doi.org/10.26803/ijlter.21.5.14


Keywords


interpersonal; intrapersonal; situational judgment test (SJT); systematic literature review (SLR); teacher selection

Full Text:

PDF

References


Ahmad, S., & Mat Zin, R. (2001). Adab & Etika Kerja Dalam Organisasi [Work Ethics & Etiquettes In Organization]. Penerbit Universiti Utara Malaysia. https://doi.org/10.32890/983955980x

Al Hashmi, W., & Klassen, R. M. (2019). Developing A Situational Judgement Test For Admission Into Initial Teacher Education In Oman: An Exploratory Study. International Journal of School and Educational Psychology, 8(1), 187–198. https://doi.org/10.1080/21683603.2019.1630042

Aldrup, K., Carstensen, B., Köller, M. M., & Klusmann, U. (2020). Measuring Teachers’ Social-Emotional Competence: Development And Validation Of A Situational Judgment Test. Frontiers in Psychology, 11, 892. https://doi.org/10.3389/fpsyg.2020.00892

Bardach, L., Rushby, J. V, Kim, L. E., & Klassen, R. M. (2021). Using Video- And Text-Based Situational Judgement Tests For Teacher Selection: A Quasi-Experiment Exploring The Relations Between Test Format , Subgroup Differences , And Applicant Reactions And Applicant Reactions. European Journal of Work and Organizational Psychology, 30(2), 251–264. https://doi.org/10.1080/1359432X.2020.1736619

Bardach, L., Rushby, J. V, & Klassen, R. M. (2021). The Selection Gap In Teacher Education: Adverse Effects Of Ethnicity, Gender, And Socio-Economic Status On Situational Judgement Test Performance. British Journal of Educational Psychology, 91(3), 1015–1034. https://doi.org/10.1111/bjep.12405

Beauchamp, G., Clarke, L., Hulme, M., & Murray, J. (2013). Research And Teacher Education: The BERA-RSA Inquiry. Policy And Practice Within The United Kingdom. In The BERA-RSA Inquiry. http://www.bera.ac.uk/resources/research-and-teacher-education-bera-rsa-inquiry

Bedwell, W. L., Fiore, S. M., & Salas, E. (2014). Developing The Future Workforce : An Approach for Integrating MBA Classroom. Academy of Management Learning & Education, 13(2), 171–186. https://doi.org/10.5465/amle.2011.0138

Bougie, R., & Sekaran, U. (2020). Research Methods For Business: A Skill-Building Approach. Eighth Edition. Wiley.

Breen, R., & Lindsay, R. (2020). Different Disciplines Require Different Motivations For Student Success. Research in Higher Education, 43, 693–725. https://doi.org/10.1023/a:1020940615784

Burmeister, O. K. (2017). Professional Ethics in the Information Age. Journal of Information, Communication and Ethics in Society, 15(4), 348–356. https://doi.org/10.1108/JICES-11-2016-0045

Chao, T.-Y., Sung, Y.-T., & Huang, J.-L. (2019). Construction Of The Situational Judgment Tests For Teachers. Asia-Pacific Journal of Teacher Education, 48(4), 355–374. https://doi.org/10.1080/1359866X.2019.1633621

Feuer, M. J., Floden, R. E., Chudowsky, N., & Ahn, J. (2013). Evaluation Of Teacher Preparation Programs : Purposes, Methods, And Policy Options. National Academy of Education.

Golubovich, J., Lake, C. J., Anguiano-Carrasco, C., & Seybert, J. (2020). Measuring Achievement Striving Via A Situational Judgment Test: The Value Of Additional Context. Revista de Psicologia Del Trabajo y de Las Organizaciones, 36(2), 157–167. https://doi.org/10.5093/jwop2020a15

Golubovich, J., Seybert, J., Martin-Raugh, M., Naemi, B., Vega, R. P., & Roberts, R. D. (2017). Assessing Perceptions Of Interpersonal Behavior With A Video-Based Situational Judgment Test. International Journal of Testing, 17(3), 191–209. https://doi.org/10.1080/15305058.2016.1194275

Gusenbauer, M. (2019). Google Scholar to Overshadow Them All? Comparing The Sizes Of 12 Academic Search Engines and Bibliographic Databases. Scientometrics., 118(1), 177–214. https://doi.org/10.1007/s11192-018-2958-5

Heckhausen, J., & Heckhausen, H. (2018). Motivation annd Action. 3rd Edition. Springer.

Karabulut-ilgu, A., Cherrez, N. J., & Jahren, C. T. (2018). A Systematic Review of Research on The Flipped Learning Method in Engineering Education. British Journal of Educational Technology, 49(3), 398–411. https://doi.org/10.1111/bjet.12548

Kataoka, H., Iwase, T., Ogawa, H., Mahmood, S., Desantis, J., Hojat, M., & Gonnella, J. S. (2018). Can Communication Skills Training Improve Empathy ? A Six-Year Longitudinal Study of Medical Students in Japan. Medical Teacher, 0(0), 1–6. https://doi.org/10.1080/0142159X.2018.1460657

Klassen, R. M., Durksen, T. L., Kim, L. E., Patterson, F., Rowett, E., Warwick, J., Warwick, P., & Wolpert, M. (2016). Developing A Proof-Of-Concept Selection Test For Entry Into Primary Teacher Education Programs. International Journal of Assessment Tools in Education, 4(2), 96–114. https://doi.org/10.21449/ijate.275772

Klassen, R. M., Durksen, T., Rowett, E., & Patterson, F. (2014). Applicant Reactions To A Situational Judgment Test Used For Selection Into Initial Teacher Training. International Journal of Educational Psychology, 3(2), 104–124. https://doi.org/10.4471/ijep.2014.07

Klassen, R. M., & Kim, L. E. (2019). Selecting Teachers And Prospective Teachers: A Meta-Analysis. Educational Research Review, 26, 32–51. https://doi.org/10.1016/j.edurev.2018.12.003

Klassen, R. M., Kim, L. E., Rushby, J. V., & Bardach, L. (2020). Can We Improve How We Screen Applicants For Initial Teacher Education? Teaching and Teacher Education, 87, 1–11. https://doi.org/10.1016/j.tate.2019.102949

Koschmieder, C., & Neubauer, A. C. (2021). Measuring Emotion Regulation For Preservice Teacher Selection: A Theory-Driven Development Of A Situational Judgment Test. Personality and Individual Differences, 168, 1–16. https://doi.org/10.1016/j.paid.2020.110363

Lazarides, R., Buchholz, J., & Rubach, C. (2018). Teacher Enthusiasm And Self-Efficacy, Student-Perceived Mastery Goal Orientation, And Student Motivation In Mathematics Classrooms. Teaching and Teacher Education, 69, 1–10. https://doi.org/10.1016/j.tate.2017.08.017

Leys, C., Arnal, C., Wollast, R., Rolin, H., Kotsou, I., & Fossion, P. (2020). Perspectives on Resilience : Personality Trait or Skill ? European Journal of Trauma & Dissociation, 4(2), 1–6. https://doi.org/10.1016/j.ejtd.2018.07.002

Li, K., Rollins, J., & Yan, E. (2017). Web Of Science Use in Published Research and Review Papers 1997–2017: A Selective, Dynamic, Cross-Domain, Content-Based Analysis. Scientometrics, 115(1), 1–20. https://doi.org/10.1007/s11192-017-2622-5

Lievens, F., & Patterson, F. (2011). The Validity and Incremental Validity of Knowledge Tests, Low-Fidelity Simulations, And High-Fidelity Simulations for Predicting Job Performance in Advanced-Level High-Stakes Selection. The Journal of Applied Psychology, 96(5), 927–940. https://doi.org/10.1037/a0023496

Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational Judgment Tests: A Review Of Recent Research. Personnel Review, 37(4), 426–441. https://doi.org/10.1108/00483480810877598

Matošková, J., & Ková?ík, M. (2017). Development Of A Situational Judgment Test As A Predictor Of College Student Performance. Journal of Psychoeducational Assessment, 35(8), 768–784. https://doi.org/10.1177/0734282916661663

Mohamed Shaffril, H. A., Samsudin, S. F., & Abu Samah, A. (2020). The ABC Of Systematic Literature Review: The Basic Methodological Guidance For Beginners. Quality & Quantity. Advance Online Publications. https://doi.org/10.1007/s11135-020-01059-6

Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Journal of Clinical Epidemiology, 62(10), 1006–1012. https://doi.org/10.1016/j.jclinepi.2009.06.005

Motowidlo, S. J., & Beier, M. E. (2010). Differentiating Specific Job Knowledge From Implicit Trait Policies In Procedural Knowledge Measured By A Situational Judgment Test. Journal of Applied Psychology, 95(2), 321–333. https://doi.org/10.1037/a0017975

Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006). Implicit Policies About Relations Between Personality Traits and Behavioral Effectiveness in Situational Judgment Items. Journal of Applied Psychology, 91(4), 749–761. https://doi.org/10.1037/0021-9010.91.4.749

Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2013). A Theoritical Basis For Situational Judgement Tests. In J. A. Weekley & R. E. Ployhart (Eds.), Situational Judgment Tests: Theory, Measurement And Application (pp. 57–82). Lawrence Erlbaum Associates, Inc.

Nadmilail, A. I., & Mohd Matore, M. E. E. (2021). Trend Of Using Situational Judgement Test On School Teachers: A Systematic Literature Review. Journal of Contemporary Issues in Business and Government, 27(2), 6117–6141. https://doi.org/10.47750/cibg.2021.27.02.607

National Research Council. (2015). Situations And Situational Judgment Tests. In National Research Council (Ed.), Measuring Human Capabilities: An Agenda For Basic Research On The Assessment Of Individual And Group Performance Potential For Military Accession (pp. 187–199). National Academies Press. https://doi.org/10.17226/19017

O’Connell, M. S., Hartman, N. S., McDaniel, M. A., Grubb, W. L., & Lawrence, A. (2007). Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance. International Journal of Selection and Assessment, 15(1), 19–29. https://doi.org/10.1111/j.1468-2389.2007.00364.x

Park, D., Tsukayama, E., Goodwin, G. P., Patrick, S., Duckworth, A. L., Luther, M., & Jr, K. (2017). A Tripartite Taxonomy of Character: Evidence for Intrapersonal, Interpersonal, and Intellectual Competencies in Children. Contemporary Educational Psychology, 48(1), 16–27. https://doi.org/10.1016/j.cedpsych.2016.08.001

Patterson, F., Ashworth, V., Zibarras, L., Coan, P., Kerrin, M., & O’Neill, P. (2012). Evaluations Of Situational Judgement Tests To Assess Non-Academic Attributes In Selection. Medical Education, 46(9), 850–868. https://doi.org/10.1111/j.1365-2923.2012.04336.x

Patterson, F., Prescott-Clements, L., Zibarras, L., Edwards, H., Kerrin, M., & Cousans, F. (2016). Recruiting For Values In Healthcare: A Preliminary Review Of The Evidence. Advances in Health Sciences Education, 21(4), 859–881. https://doi.org/10.1007/s10459-014-9579-4

Patterson, F., & Zibarras, L. (2018). Selection And Recruitment In The Healthcare Professions: Research, Theory And Practice. In Palgrave MacMillan. Palgrave Macmillan. https://doi.org/10.1007/978-3-319-94971-0

Patterson, F., Zibarras, L., & Ashworth, V. (2016). Situational Judgement Tests In Medical Education And Training: Research, Theory And Practice: AMEE Guide No. 100. Medical Teacher, 38(1), 3–17. https://doi.org/10.3109/0142159X.2015.1072619

Pavlidou, K., Alevriadou, A., & Antoniou, A. S. (2020). Professional Burnout In General And Special Education Teachers: The Role Of Interpersonal Coping Strategies. European Journal of Special Needs Education, 1–18. https://doi.org/10.1080/08856257.2020.1857931

Peterson, A., & Arthur, J. (2021). Ethics And The Good Teacher. Routledge.

Ployhart, R. E. (2013). The Predictor Response Process Model. In J. A. Weekley & R. E. Ployhart (Eds.), Situational Judgment Tests: Theory, Measurement and Application (pp. 83–106). Lawrence Erlbaum Associates, Inc.

Ryan, A. M., & Ployhart, R. E. (2014). A Century of Selection. Annual Review of Psychology, 65(1), 693–717. https://doi.org/10.1146/annurev-psych-010213-115134

Sambaiah, M., & Aneel, Y. (2016). Intrapersonal Skills As Core Of The Personality: Some Home Truths. Journal of English Language and Literature, 3(1), 225–230.

Schleicher, A. (2014). Equity, Excellence and Inclusiveness in Education: Policy Lessons from Around the World, International Summit on the Teaching Profession. OECD Publishing.

Schroder, H. S., Yalch, M. M., Dawood, S., Callahan, C. P., Donnellan, M. B., & Moser, J. S. (2017). Growth Mindset Of Anxiety Buffers The Link Between Stressful Life Events And Psychological Distress And Coping Strategies. Personality and Individual Differences, 110, 23–26. https://doi.org/10.1016/j.paid.2017.01.016

Seaton, F. S. (2018). Empowering Teachers to Implement A Growth Mindset. Educational Psychology in Practice, 34(1), 41–57. https://doi.org/10.1080/02667363.2017.1382333

Stoll, G., Einarsdóttir, S., Song, Q. C., Ondish, P., Sun, J. J., & Rounds, J. (2020). The Roles of Personality Traits and Vocational Interests in Explaining What People Want Out of Life. Journal of Research in Personality, 86, 1–37. https://doi.org/10.1016/j.jrp.2020.103939

Tohidi, H., & Jabbari, M. M. (2012). The Effects of Motivation in Education. Procedia - Social and Behavioral Sciences, 31, 820–824. https://doi.org/10.1016/j.sbspro.2011.12.148

Turiano, N. A. (2020). Conscientiousness. In V. Zeigler-Hill & T. K. Shackelford (Eds.), Encyclopedia of Personality and Individual Differences (pp. 848–853). Springer.

Webster, E. S., Paton, L. W., Crampton, P. E. S., & Tiffin, P. A. (2020). Situational Judgement Test Validity for Selection: A Systematic Review and Meta-Analysis. Medical Education, 54(10), 888–902. https://doi.org/10.1111/medu.14201

Weekley, J. A., Ployhart, R. E., & Holtz, B. C. (2013). On the Development of Situational Judgement tests: Issues in Item Development, Scaling and Scoring. In J. A. Weekley & R. E. Ployhart (Eds.), Situational Judgment Tests: Theory, Measurement and Application (pp. 157–182). Lawrence Erlbaum Associates, Inc.

Whetzel, D. L., Sullivan, T. S., & McCloy, R. A. (2020). Situational Judgment Tests: An Overview Of Development Practices And Psychometric Characteristics. Personnel Assessment and Decisions, 6(1), 1–16. https://doi.org/10.25035/pad.2020.01.001

Zakaria, M. H., Yatim, B., & Ismail, S. (2014). Implementation Of Graduate Employability Skills SJT Instrument In Universiti Utara Malaysia. AIP Conference Proceedings, 1635, 962–965. https://doi.org/10.1063/1.4903698

Zhu, J., & Liu, W. (2020). A Tale of Two Databases: The Use of Web of Science and Scopus in Academic Papers. Scientometrics. Advance Online Publication., 123(1), 321–335. https://doi.org/10.1007/s11192-020-03387-8


Refbacks

  • There are currently no refbacks.


e-ISSN: 1694-2116

p-ISSN: 1694-2493