Development and psychometric examination of a German video-based situational judgment test for social competencies in medical school applicants

2017 ◽  
Vol 25 (1) ◽  
pp. 94-110 ◽  
Author(s):  
Melanie Fröhlich ◽  
Janine Kahmann ◽  
Martina Kadmon
2011 ◽  
Vol 24 (3) ◽  
Author(s):  
Marit R.E. Op de Beek ◽  
Janneke K. Oostrom ◽  
Marise Ph. Born

The webcam test as a predictor of professional behavior The webcam test as a predictor of professional behavior Gedrag & Organisatie, volume 24, September 2011, nr 3, pp. 257-285.The webcam test is a new video assessment designed to measure social competencies. The main purpose of this study was to investigate the criterion-related validity of the webcam test and its incremental validity over and above a cognitive ability test, a personality questionnaire and a video-based situational judgment test. The sample consisted of 106 psychology students. In line with our expectations, the webcam test showed a significant correlation with the criterion professional behavior, a questionnaire about students’ motivation, chairmanship and preparation. Furthermore, the webcam test showed incremental validity over and above the other selection tests. Participants perceived the webcamtest as more face valid than the cognitive ability test and the personality questionnaire. However, the video-based situational judgment test was perceived as more face valid than the webcamtest. Limitations of this study and suggestions for further study are discussed.


Author(s):  
Jorie M. Colbert-Getz ◽  
Karly Pippitt ◽  
Benjamin Chan

Purpose: The situational judgment test (SJT) shows promise for assessing the non-cognitive skills of medical school applicants, but has only been used in Europe. Since the admissions processes and education levels of applicants to medical school are different in the United States and in Europe, it is necessary to obtain validity evidence of the SJT based on a sample of United States applicants. Methods: Ninety SJT items were developed and Kane’s validity framework was used to create a test blueprint. A total of 489 applicants selected for assessment/interview day at the University of Utah School of Medicine during the 2014-2015 admissions cycle completed one of five SJTs, which assessed professionalism, coping with pressure, communication, patient focus, and teamwork. Item difficulty, each item’s discrimination index, internal consistency, and the categorization of items by two experts were used to create the test blueprint. Results: The majority of item scores were within an acceptable range of difficulty, as measured by the difficulty index (0.50-0.85) and had fair to good discrimination. However, internal consistency was low for each domain, and 63% of items appeared to assess multiple domains. The concordance of categorization between the two educational experts ranged from 24% to 76% across the five domains. Conclusion: The results of this study will help medical school admissions departments determine how to begin constructing a SJT. Further testing with a more representative sample is needed to determine if the SJT is a useful assessment tool for measuring the non-cognitive skills of medical school applicants.


Author(s):  
Jean-Michel Leduc ◽  
Victoire Kpadé ◽  
Samantha Bizimungu ◽  
Martine Bourget ◽  
Isabelle Gauthier ◽  
...  

To address the underrepresentation of Black students in medical schools in Canada and identify barriers in selection processes, we compare data from the latest Canadian census to that of an exit-survey conducted after a situational judgment test (Casper) among medical school applicants and from questionnaires done after selection interviews in Quebec, Canada. The proportion of Black people aged 15-34 years old in Quebec in 2016 was 5.3% province-wide and 8.2% in the Montreal metropolitan area. The proportion in the applicant pool for 2020 in Quebec was estimated to be 4.5% based on Casper exit-survey data. Comparatively, it is estimated that Black people represented 1.8% of applicants invited to admission interviews and 1.2% of admitted students in Quebec in 2019. Although data from different cohorts and data sources do not allow for direct comparisons, these numbers suggest that Black students applying to medical school are disproportionately rejected at the first step compared to non-Black students. Longitudinal data collection among medical school applicants will be necessary to monitor the situation. Further studies are required to pinpoint the factors contributing to this underrepresentation, to keep improving the equity of our selection processes.


2008 ◽  
Vol 93 (2) ◽  
pp. 250-267 ◽  
Author(s):  
Troy V. Mumford ◽  
Chad H. Van Iddekinge ◽  
Frederick P. Morgeson ◽  
Michael A. Campion

2012 ◽  
Author(s):  
Janneke K. Oostrom ◽  
Henk T. Van der Molen ◽  
Alec W. Serlie ◽  
Marise Ph. Born

2007 ◽  
Author(s):  
Laura G. Barron ◽  
Stephan J. Motowidlo ◽  
Margaret E. Beier ◽  
Tracy Kantrowitz ◽  
Courtney L. Holladay ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document