situational judgement test
149461570
Culture as a determinant of option choice in a situational judgement test: A new look
Past research on cultural correlates of biased items in multiple choice tests have almost always considered post hoc explanations that have not been very convincing and they have considered only differential subgroup responses to the correct or preferred answer. In an effort to determine the degree to which culture explains the difference between Chinese and Americans' responses to a situational judgement test (SJT) 135 options to 25 SJT items were rated on the degree to which they reflected seven dimensions of culture. Ratings of the cultural content of the optionswere significantly andmoderately correlated with Chinese American differences inMost Likely responses to the options. In addition, a loglinear analysis of differential distractor functioning (DDF) yielded results consistent with the hypothesis that culture was at least partly the reason for subgroup differences in option choices and the resultant findings of DDF. The results suggest that SJTs and perhaps other non academic measures must be used with caution across cultural groups.
Neal Schmitt Joshua J Prasad Ann Marie Ryan Jacob C Bradburn Christopher D Nye
150257257
Development and validation of a situational judgement test of Japanese leadership knowledge
ABSTRACT Leadership research has accumulated a wealth of empirical findings about what leadership behaviours are effective in various business environments. We took advantage of these empirical findings to develop a situational judgement test (SJT) of leadership knowledge with correct answers. The SJT contains four leadership dimensions: task focused, relationship focused, transformational, and developmental leadership. Item response theory and confirmatory factor analyses were used to examine the psychometric properties of the SJT, based on a sample of 658 Japanese college students. Ultimately, we confirmed a four factor model and retained 21 of 53 situation questions for the final SJT.
Toshio Murase Adam Arthur Roebuck Kiyoshi Takahashi
210964120
Situational judgement test: Psychometric analysis of a pilot study for selecting post graduate medical student in residency program
Introductions: Selection process of post graduate medical students requires combination of knowledge, cognitive abilities and skills. Situational judgement test (SJT) is one on the important tools to measure cognitive abilities and skills. This study aims to measure the internal consistency reliability of SJT tool and item quality for local validation of the non academic attributes. It also aims to do sub group analysis of SJT scores based on this tool to provide further evidence for validity. Methods: This cross sectional study was conducted at Patan Academy of Health Sciences (PAHS) in May 2017. Two sets of SJTs were developed after iterative discussion and modification to suit the local context. Set A had five options to a given situation, students had to rank these options from most appropriate to least appropriate. Set B had seven options to a given situations, students had to pick three best options. Medical officers and interns who were working at PAHS as medical officers participated in this study. Results: One hundred and sixteen medical officers participated in the study. Thirty nine (33.6% participants were interns who had graduated from PAHS and 77 (66.4% were medical officers who had graduated from various institute inside and outside the Nepal. The overall Cronbach's alpha for 35 questions was 0.65, that for set A (19 questions) was 0.56 and that for set B (16 questions) was 0.52. Adding SJT questions improved value of Cronbach's alpha for SJT test as 40, 50, 60 and 70 questions gave Cronbach's alpha of 0.68, 0.73, 0.76 and 0.79. Average percentage correct of set A was 76.3% and that of set B was 60.5% SJT scores were statistically different for medical graduates from Nepal and different universities within Nepal. Conclusions: Locally developed situational judgement test is found to be reliable instrument for measuring non academic construct of postgraduate medical entrance examination.
Ashish Shrestha Shital Bhandary Shrijana Shrestha
213628798
Measuring Integrity for Selection into Medical School Development of a Situational Judgement Test
This thesis examines the use of a Situational Judgement Test (SJT) for the selection into medical school based on the noncognitive attribute of integrity. Specifically, this thesis describes five studies that investigate how several test characteristics influence a number of quality criteria of an SJT in measuring integrity among medical school applicants.
Wendy de Leng
214414588
ANALISIS EMPLOYABILITY SKILLS MAHASISWA MENGGUNAKAN PENDEKATAN SITUATIONAL JUDGEMENT TEST
Penelitian ini bertujuan untuk; (1) mengetahui gambaran tingkat employability skills mahasiswa pada aspek keterampilan fundamental, keterampilan manajemen pribadi dan keterampilan bekerjasama menggunakan pendekatan situational judgement test; (2) menjelaskan pengaruh keterampilan fundamental, keterampilan manajemen pribadi, keterampilan bekerjasama terhadap kesiapan kerja mahasiswa. Penelitian ini bersifat ex post facto. Populasi dan Sampel penelitian adalah mahasiswa STMIK Profesional Makassar tahun ajaran 2018/2019 yang berjumlah 144 orang. Instrument menggunakan tes dan angket. Hasil penelitian menujukan (1) gambaran tingkat employability skills mahasiswa melalui tes situational judgement test pada aspek keterampilan fundamental dan manajemen pribadi dalam kategori tinggi, aspek keterampilan bekerjasama dalam kategori sangat tinggi, (2) keterampilan fundamental berkontribusi membangun kesiapan kerja mahasiswa sebesar 10,1% 3) keterampilan manajemen pribadi berkontribusi membangun kesiapan kerja mahasiswa sebesar 9% (4) keterampilan bekerjasama berkontribusi membangun kesiapan kerja mahasiswa sebesar 40,5% (5) keterampilan fundamental, manajemen pribadi dan bekerjasama secara bersama sama berkonstribusi membangun kesiapan kerja mahasiswa sebesar 60,2% Berdasarkan hasil tersebut maka disimpulkan bahwa tingkat employability skills mahasiswa dalam kategori tinggi serta employability skills berkontribusi membangun kesiapan kerja mahasiswa.
A Hermila Muhammad Yahya Syahrul Syahrul
214248481
Situational Judgement Test
Gabriele Steuer Tobias Engelschalk Nicole Eckerlein Markus Dresel
148575893
The development of a situational judgement test of personal attributes for quality teaching in rural and remote Australia
Education authorities in Australia are calling for valid tools to help assess prospective teachers' non academic attributes, with a particular need for identifying those attributes necessary for effective teaching in specific contexts. With the New South Wales (NSW) Department of Education, we aimed to develop a scenario based tool to help assess the non academic attributes necessary for beginning teachers working in rural and remote settings. Using a situational judgement test (SJT) methodology, we worked with experienced teachers (n 19) to develop scenario based items, which were then reviewed by school principals (n 13) The teachers also adapted items previously developed and piloted in the UK. Next, prospective NSW teachers (n 99) tried 32 new and adapted items targeting four clusters of attributes: empathy and communication, resilience and adaptability, organisation and planning, and culture and context. Item quality analyses revealed 22 acceptable items. We conclude by suggesting SJTs for promoting non academic growth of prospective and beginning teachers.
Tracy L Durksen Robert M Klassen
34399476
Exploring uses of the UK Clinical Aptitude Test situational judgement test in a dental student selection process
AIM In 2013 the UKCAT included a non cognitive situational judgement test in addition to the four cognitive subtests commonly used by UK dental schools to select students. However, little is known about the situational judgement test's psychometric properties and relationship to other selection tools. This study's aim was explore these issues to inform decisions about the inclusion of the UKCAT SJT in the dental student selection process. METHOD The sample comprised a cohort of applicants to a Bachelor of Dental Surgery programme, at a UK dental school, which does not use achievement in the UKCAT SJT in its selection process. The impact on applicant outcomes of two theoretical uses of the UKCAT SJT was examined. First, SJT Band was used as the criterion for offers of a place instead of the school's admission interview, and second, weighted UKCAT scores, including a weighted SJT Band score, were ranked to make interview invitation decisions. Associations between SJT Band, UKCAT cognitive scores, interview score and performance in first year assessments were examined. RESULTS If SJT Band 1 2 were used as the criterion for an offer of a place, some applicants rejected by this school's interview, including 'red flagged' applicants, would have received an offer of a place. Using a weighted UKCAT/SJT system for invitation for interview decisions increased the mean total UKCAT cognitive score of those invited for interview but included applicants rejected by this school's structured interview, including 'red flagged' applicants. Neither usage disadvantaged under represented groups. SJT Band correlated with UKCAT score (n 228, rs 0.38, P 0.01) with interview score (n 186, rs 0.17, P 0.05) but not with first year study assessments. CONCLUSION This study has shown that the UKCAT SJT does not add value to the existing methods of this dental school to make valid, reliable and fair student selection decisions.
European journal of dental education official journal of the Association for Dental Education in Europe
Paul J Lambe Elizabeth Kay David Bristow
4353351
Integrity situational judgement test for medical school selection: judging 'what to do' versus 'what not to do'
Despite their widespread use in medical school selection, there remains a lack of clarity on exactly what situational judgement tests (SJTs) measure.
Medical education
Wendy E de Leng Karen M Stegers-Jager Marise Ph Born Axel P N Themmen
53787047
Influence of response instructions and response format on applicant perceptions of a situational judgement test for medical school selection
BackgroundThis study examined the influence of two Situational Judgement Test (SJT) design features (response instructions and response format) on applicant perceptions. Additionally, we investigated demographic subgroup differences in applicant perceptions of an SJT.MethodsMedical school applicants (N 372) responded to an online survey on applicant perceptions, including a description and two example items of an SJT. Respondents randomly received one of four SJT versions (should do rating, should do pick one, would do rating, would do pick one) They rated overall favourability and items on four procedural justice factors (face validity, applicant differentiation, study relatedness and chance to perform) and ease of cheating. Additionally, applicant perceptions were compared for subgroups based on gender, ethnic background and first generation university status.ResultsApplicants rated would do instructions as easier to cheat than should do instructions. Rating formats received more favourable judgements than pick one formats on applicant differentiation, study relatedness, chance to perform and ease of cheating. No significant main effect for demographic subgroup on applicant perceptions was found, but significant interaction effects showed that certain subgroups might have more pronounced preferences for certain SJT design features. Specifically, ethnic minority applicants but not ethnic majority applicants showed greater preference for should do than would do instructions. Additionally, first generation university students but not non first generation university students were more favourable of rating formats than of pick one formats.ConclusionsFindings indicate that changing SJT design features may positively affect applicant perceptions by promoting procedural justice factors and reducing perceived ease of cheating and that response instructions and response format can increase the attractiveness of SJTs for minority applicants.
BMC medical education
Wendy E de Leng Karen M Stegers-Jager Marise Ph Born Axel P N Themmen