1887
  1. Home
  2. A-Z Publications
  3. Qatar Medical Journal
  4. Volume 2021, Issue 2
  5. Article
Volume 2021, Issue 2
  • ISSN: 0253-8253
  • EISSN: 2227-0426

Abstract

Background: Well-performing physician reflects the success of the residency program in selecting the best candidates for training. This study aimed to evaluate the selection criteria, mainly the United States Medical Licensing Examination (USMLE) Step 2 Clinical Knowledge (CK) results and applicants’ status as international or locally trained applicants, used by the medical education department and the internal medicine residency program in Hamad Medical Corporation in Qatar to predict the residents’ performance during their training.

Methods: A retrospective chart review was performed for three batches of graduates who started residency training in 2011, 2012, and 2013. Each group completed 4 years of training. The USMLE Step 2 CK status of the applicant, in-training exam (ITE) scores, formative evaluation scores, Arab Board written and clinical exams pass rate, and other indicators were analyzed. Statistical analysis included chi squares and independent t-test to identify associations. Multivariable analyses were conducted using logistic and linear regressions to test for adjusted associations.

Results: The study included 118 (81 international/37 locally trained applicants) internal medicine residents. The ITE score correlated positively with the USMLE Step 2 CK score (r = 0.621, r = 0.587, r = 0.576, r = 0.571,  < 0.001) over the 4 years of training and among the international compared with locally trained applicants ( < 0.001). The rate of passing part 1 and 2 written exam of the Arab Board was higher in international than in local applicants, whereas clinical Arab Board exam and formative evaluation were not associated with any criteria.

Conclusions: Higher USMLE Step 2 CK score correlated with better performance on ITE but not with other performance indicators, whereas international applicants did better in both ITE and Arab Board written exam than local applicants. These variables may provide reasonable predictors of well-performing physicians.

© 2021 Rahil, Hamamyh, Al-Mohammed, Kamel, Abubeker, Abu-Raddad, Dargham, Suliman, Al Mohanadi, Al Khal, licensee HBKU Press.
Loading

Article metrics loading...

/content/journals/10.5339/qmj.2021.20
2021-06-21
2024-11-08
Loading full text...

Full text loading...

/deliver/fulltext/qmj/2021/2/qmj.2021.20.html?itemId=/content/journals/10.5339/qmj.2021.20&mimeType=html&fmt=ahah

References

  1. Stephenson-Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the interview in resident candidate selection: A review of the literature. J Grad Med Educ 2015; 7:(4):539–48.
     [Google Scholar]
  2. Who is USMLE? (Available from: https://www.usmle.org/about/.).
  3. McGaghie WC, Cohen ER, Wayne DB. Are United States Medical Licensing Exam Step 1 and 2 scores valid measures for postgraduate medical residency selection decisions? Acad Med 2011; 86:(1):48–52.
     [Google Scholar]
  4. Kanna B, Gu Y, Akhuetie J, Dimitrov V. Predicting performance using background characteristics of international medical graduates in an inner-city university-affiliated Internal Medicine residency training program. BMC Med Educ 2009; 9:42:.
     [Google Scholar]
  5. Schaverien MV. Selection for surgical training: An evidence-based review. J Surg Educ 2016; 73:(4):721–9.
     [Google Scholar]
  6. Cuddy MM, Winward ML, Johnston MM, Lipner RS, Clauser BE. Evaluating validity evidence for USMLE Step 2 clinical skills data gathering and data interpretation scores: Does performance predict history-taking and physical examination ratings for first-year internal medicine residents? Acad Med 2016; 91:(1):133–9.
     [Google Scholar]
  7. Winward ML, Lipner RS, Johnston MM, Cuddy MM, Clauser BE. The relationship between communication scores from the USMLE Step 2 Clinical Skills examination and communication ratings for first-year internal medicine residents. Acad Med 2013; 88:(5):693–8.
     [Google Scholar]
  8. Redmann AJ, Tawfik KO, Myer CM. The impact of a resident-run review curriculum and USMLE scores on the Otolaryngology in-service exam. Int J Pediatr Otorhinolaryngol 2018;104:25–8.
     [Google Scholar]
  9. Welch TR, Olson BG, Nelsen E, Beck Dallagha GL, Kennedy GA, Botash A. United States medical licensing examination and American Board of Pediatrics certification examination results: Does the residency program contribute to trainee achievement. J Pediatr 2017;188:270–4.e3.
     [Google Scholar]
  10. Nagasawa DT, Beckett JS, Lagman C, Chung LK, Schmidt B, Safaee M, et al. United States medical licensing examination Step 1 scores directly correlate with American Board of Neurological Surgery scores: A single-institution experience. World Neurosurg 2017;98:427–31.
     [Google Scholar]
  11. The Interna, Medicine Milestone Project (Available from: https://www.acgme.org/Portals/0/PDFs/Milestones/InternalMedicineMilestones.pdf?ver = 2017–07-28–090326-787 .
  12. Marcus-Blank B, Dahlke JA, Braman JP, Borman-Shoap E, Tiryaki E, Chipman J, et al. Predicting performance of first-year residents: Correlations between structured interview, licensure exam, and competency scores in a multi-institutional Study. Acad Med 2019; 94:(3):378–87.
     [Google Scholar]
  13. Rayamajhi S, Dhakal P, Wang L, Rai MP, Shrotriya S. Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results? BMC Med Educ 2020; 20:(1):79.
     [Google Scholar]
  14. McDonald FS, Zeger SL, Kolars JC. Associations between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) scores. J Gen Intern Med 2008; 23:(7):1016–9.
     [Google Scholar]
  15. Grossman RS, Fincher RM, Layne RD, Seelig CB, Berkowitz LR, Levine MA. Validity of the in-training examination for predicting American Board of Internal Medicine certifying examination scores. J Gen Intern Med 1992; 7:(1):63–7.
     [Google Scholar]
  16. Grossman RS, Murata GH, Fincher RM, Norcini JJ, Kapsner C, Layne RD, et al. Predicting performance on the American Board of Internal Medicine Certifying Examination: The effects of resident preparation and other factors. Crime Study Group. Acad Med 1996; 71:(10 Suppl):S74–6.
     [Google Scholar]
  17. Rollins LK, Martindale JR, Edmond M, Manser T, Scheld WM. Predicting pass rates on the American Board of Internal Medicine certifying examination. J Gen Intern Med 1998; 13:(6):414–6.
     [Google Scholar]
  18. Babbott SF, Beasley BW, Hinchey KT, Blotzer JW, Holmboe ES. The predictive validity of the internal medicine in-training examination. Am J Med 2007; 120:(8):735–40.
     [Google Scholar]
  19. Brateanu A, Yu C, Kattan MW, Olender J, Nielsen C. A nomogram to predict the probability of passing the American Board of Internal Medicine examination. Med Educ Online 2012; 17:(1):18810.
     [Google Scholar]
  20. Perez Jr JA,Greer S. Correlation of United States Medical Licensing Examination and Internal Medicine In-Training Examination performance. Adv Health Sci Educ Theory Pract 2009; 14:(5):753–8.
     [Google Scholar]
  21. Kenny S, McInnes M, Singh V. Associations between residency selection strategies and doctor performance: A meta-analysis. Med Educ 2013; 47:(8):790–800.
     [Google Scholar]
  22. Black KP, Abzug JM, Chinchilli VM. Orthopaedic in-training examination scores: A correlation with USMLE results. J Bone Joint Surg Am 2006; 88:(3):671–6.
     [Google Scholar]
  23. Andriole DA, Jeffe DB, Whelan AJ. What predicts surgical internship performance? Am J Surg 2004; 188:(2):161–4.
     [Google Scholar]
  24. Norcini JJ, Boulet JR, Opalek A, Dauphinee WD. The relationship between licensing examination performance and the outcomes of care by international medical school graduates. Acad Med 2014; 89:(8):1157–62.
     [Google Scholar]
  25. Cuddy MM, Young A, Gelman A, Swanson DB, Johnson DA, Dillon GF, et al. Exploring the relationships between USMLE performance and disciplinary action in practice: A validity study of score inferences from a licensure examination. Acad Med 2017; 92:(12):1780–5.
     [Google Scholar]
/content/journals/10.5339/qmj.2021.20
Loading
Do the selection criteria of internal medicine residency program predict resident performance?
Qatar Medical Journal 2021, 20 (2021); https://doi.org/10.5339/qmj.2021.20
/content/journals/10.5339/qmj.2021.20
/content/journals/10.5339/qmj.2021.20
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): ACGME-I, ITE, medical education and USMLE

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error