Elsevier

Ambulatory Pediatrics

Volume 5, Issue 4, July–August 2005, Pages 216-220
Ambulatory Pediatrics

The Impact of the Interview in Pediatric Residency Selection

https://doi.org/10.1367/A04-149R1.1Get rights and content

Objective.—To better understand the impact of USMLE scores and interview scores on the National Resident Matching Program (NRMP) rank of applicants to the residency program at The Children's Hospital of Philadelphia.

Methodology.—We evaluated 935 applicants' files from 2000, 2001, and 2002. For each candidate, one interviewer had access to the full application, while the other interviewer was blinded to USMLE scores and grades. Interview scores were generated by both interviewers. Statistical analysis was performed to evaluate relationships between USMLE scores, interview scores, and NRMP rank list number.

Results.—There were a wide range of USMLE scores among candidates who interviewed (range 181 to 269, 227.7 ± 17.1, M ± standard deviation). USMLE scores were weakly correlated to nonblinded interview scores (r = −0.17), final committee scores (r = −0.26), and NRMP ranking (r = −0.21): P < .0005. Blinded interviews did not correlate with USMLE scores. Both nonblinded and blinded interviews had stronger correlations with NRMP rank list number (r = 0.49, P < .0005 and r = 0.36, P < .0005, respectively). The nonblinded interview accounted for 20.6% of variance in the NRMP rank list order.

Conclusions.—Interview scores were the most important variable for candidate ranking on the NRMP list. Furthermore, when interviewers had access to board scores, there was a modest correlation to performance on the USMLE. While interviews may reflect a candidate's personality, they may not effectively measure desired characteristics when access to academic markers is unrestricted. We suggest incorporating blinded interviews into the selection process to give candidates a better opportunity to display communication skills, emotional stability, and “fit” for the program.

Section snippets

Subjects

All subjects in the study submitted applications for a position as a pediatric house officer at The Children's Hospital of Philadelphia (CHOP) between the years 1999 and 2002. The data from 935 candidates' files were reviewed; data included date of birth, medical school attended, USMLE Step 1 scores, interview scores, selection committee scores, and final rank number on the list for the NRMP. In the academic year 1999–2000, 330 candidates accepted on-site interview invitations to the hospital.

RESULTS

Table 1 shows the demographic characteristics of the 935 candidates who interviewed for the residency program during 2000, 2001, and 2002. Among the group, the mean age was 27.2 ± 2.5, mean ± SD (range 23–39). Women comprised 67% (626/935) of applicants, while 30% of candidates (282/934) who interviewed for spots in the residency program were listed as members of AOA. There was a broad distribution of USMLE Step 1 scores among candidates who interviewed (range 181 to 269, 227.7 ± 17.1, mean ±

DISCUSSION

Papp et al6 stated that a resident's performance is a function of both who an individual is when admitted and who she or he becomes while in the program. Although the magnitude of the correlation was modest, our results demonstrate that knowledge of a candidate's USMLE score may bias the selection process. When USMLE scores were available to interviewers, trends in interview scores paralleled USMLE scores. However, in both 2001 and 2002, when non-ISC interviewers were blinded to USMLE scores,

REFERENCES (18)

There are more references available in the full text version of this article.

Cited by (21)

  • Self-Assessment in General Surgery Applicants: An Insight Into Interview Performance

    2022, Journal of Surgical Research
    Citation Excerpt :

    Interviews are integral in finding the nontangible social and personal traits of applicants that are crucial for success as a physician. In fact, personal traits assessed during interviews may be more reliable in predicting clinical performance during residency than objective measures.6,8,9 In addition, now more than ever, there are growing expectations for physicians to possess strong interpersonal skills and social aptitude, which increase patient satisfaction and ensure optimal patient-centered care.10-13

  • Can Behavior-Based Interviews Reduce Bias in Fellowship Applicant Assessment?

    2022, Academic Pediatrics
    Citation Excerpt :

    Even though faculty were exposed to application information prior to their interview, it did not seem to negatively affect their BBI-based scores. Many specialties have reported on the importance of the interview in recruitment, with some stating that their rank list was primarily determined by the applicant interview.4,5,14,15,34,35 Despite the perception both by our faculty and in the literature that interviews are important in ranking applicants, it is interesting to note that most faculty reported no training in interviewing.

  • Evidence-Based Selection of Surgical Residents

    2021, Surgical Clinics of North America
    Citation Excerpt :

    Questions can be customized to target emotional intelligence facets that are considered essential in a surgical trainee. Blinding interviewers to application data, such as USMLE scores, effectively decreases biases toward cognitive measures, such as grades and scores.63–65 Although bias favoring academic success is limited by blinding, it can be argued that it should not be.

View all citing articles on Scopus
View full text